-- Logs begin at Wed 2022-05-25 13:03:32 UTC, end at Wed 2022-05-25 13:56:07 UTC. -- May 25 13:49:53.776842 dv-cinder-843277-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 25 13:49:53.784067 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 13:49:53.786020 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 13:49:53 2022] *** May 25 13:49:53.786020 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 13:49:53.786020 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 13:49:53.786020 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: nodename: dv-cinder-843277-1-iscsi May 25 13:49:53.786020 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: machine: x86_64 May 25 13:49:53.786020 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: clock source: unix May 25 13:49:53.786409 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: pcre jit disabled May 25 13:49:53.786409 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: detected number of CPU cores: 4 May 25 13:49:53.786409 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: current working directory: / May 25 13:49:53.786409 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: detected binary path: /usr/bin/uwsgi-core May 25 13:49:53.786409 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: your processes number limit is 47680 May 25 13:49:53.786409 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: your memory page size is 4096 bytes May 25 13:49:53.786409 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: detected max file descriptor number: 2048 May 25 13:49:53.786409 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: lock engine: pthread robust mutexes May 25 13:49:53.786409 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: thunder lock: enabled May 25 13:49:53.786409 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 13:49:53.787002 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 13:49:53.832233 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: Python main interpreter initialized at 0x55cc5bd359c0 May 25 13:49:53.832233 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: python threads support enabled May 25 13:49:53.832233 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: your server socket listen backlog is limited to 100 connections May 25 13:49:53.832233 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: your mercy for graceful operations on workers is 90 seconds May 25 13:49:53.832618 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: mapped 403077 bytes (393 KB) for 2 cores May 25 13:49:53.832693 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: *** Operational MODE: preforking *** May 25 13:49:53.832950 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: *** uWSGI is running in multiple interpreter mode *** May 25 13:49:53.832950 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: spawned uWSGI master process (pid: 80384) May 25 13:49:53.833156 dv-cinder-843277-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 25 13:49:53.834000 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: spawned uWSGI worker 1 (pid: 80398, cores: 1) May 25 13:49:53.834107 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: spawned uWSGI worker 2 (pid: 80399, cores: 1) May 25 13:49:53.838037 dv-cinder-843277-1-iscsi devstack@keystone.service[80384]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 13:49:59.542369 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 13:49:59.542369 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: from cryptography.utils import int_from_bytes May 25 13:49:59.543142 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 13:49:59.543142 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: from cryptography.utils import int_from_bytes May 25 13:49:59.543264 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 13:49:59.543264 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: from cryptography.utils import int_from_bytes May 25 13:49:59.543264 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 13:49:59.543264 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: from cryptography.utils import int_from_bytes May 25 13:49:59.592184 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 13:49:59.592333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 13:49:59.592413 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 13:49:59.592490 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 13:49:59.592556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] command line args: [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 13:49:59.592613 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] command line args: [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 13:49:59.592765 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 13:49:59.592863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 13:49:59.592935 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ================================================================================ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 13:49:59.593009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ================================================================================ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 13:49:59.593396 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] admin_token = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.593486 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] admin_token = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.593637 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] config_dir = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.593724 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] config_dir = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.593801 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.593871 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.593982 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] config_source = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.594066 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] config_source = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.594142 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] debug = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.594219 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] debug = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.594337 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.594585 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.594679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.594748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.594879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.594984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.595085 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.595184 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.595332 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.595451 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.595547 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.595645 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.595774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] log_config_append = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.595882 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] log_config_append = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.595983 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.596088 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.596198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] log_dir = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.596293 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] log_dir = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.596386 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] log_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.596485 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] log_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.596579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.596680 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.596781 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.596876 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.596977 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.597082 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.597189 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.597313 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.597435 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.597512 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.597625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.597706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.597829 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.597911 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.597982 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.598054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.598130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.598250 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.598387 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.598461 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.598573 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.598654 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.598773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.598893 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.599016 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.599105 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.599257 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.599381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.599528 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.599606 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.600037 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.600164 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.600251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] publish_errors = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.600333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] publish_errors = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.600972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.601238 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.601457 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.601583 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.601670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.601748 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.601862 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.601956 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.602107 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.602181 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.602301 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] standard_threads = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.602382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] standard_threads = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.602453 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.602570 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.602662 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.602782 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.602857 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.602933 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.603003 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] use_journal = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.603071 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] use_journal = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.603139 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] use_json = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.603214 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] use_json = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.603290 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] use_stderr = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.603359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] use_stderr = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.603433 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] use_syslog = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.603502 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] use_syslog = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.603580 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.603707 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:49:59.603855 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.603981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.604092 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.604219 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.604347 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.604475 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.604581 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.604712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.604823 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.604958 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.605042 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.605192 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.605318 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.605436 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.605514 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.605669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.605755 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.605912 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.605988 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.606155 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.606231 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.606398 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.606483 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.606630 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.606713 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.606859 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.606935 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.607093 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.607244 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.607318 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.607387 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.607550 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.607626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.607810 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.607902 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.608056 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.608133 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.608296 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.608379 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.608525 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.608609 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.608756 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.608838 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.609006 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.609083 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.609249 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.609331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.609492 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.609569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.609718 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.609794 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.609943 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.610020 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.610167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.610244 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.610394 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.610469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.610627 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.610711 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.610866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.610942 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.611091 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.611175 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.611316 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.611393 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.611545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.611626 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.611808 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.611917 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.612025 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.612127 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.612272 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.612374 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.612499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.612603 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.612735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.612867 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.612953 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.613024 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.613174 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.613254 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.613398 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.613484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.613622 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.613700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.613846 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.613963 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.614072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.614149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.614305 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.614385 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.614526 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.614604 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.614755 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.614840 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.614978 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.615057 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.615204 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.615284 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.615430 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.615514 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.615660 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.615818 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.615919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.615996 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.616196 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.616809 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.616917 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.617036 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.617151 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.617225 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.617385 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.617463 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.617618 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.617692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.617852 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.617929 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.618079 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.618169 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.618312 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.618394 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.618544 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.618621 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.618771 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.618849 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.618997 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.619074 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.619240 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.619318 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.619464 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.619550 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.619694 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.619822 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.619947 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.620025 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.620178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.620269 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.620429 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.620506 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.620667 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.620742 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.620903 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.620988 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.621134 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.621211 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.621362 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.621439 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.621590 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.621675 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.621821 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.621897 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.622051 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.622127 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.622281 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.622369 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.622511 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.622589 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.622740 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.622822 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.622969 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.623047 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.623197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.623282 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.623425 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.623502 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.623652 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.623747 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.623909 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.623987 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.624157 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.624234 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.624394 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.624469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.624624 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.624702 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.624857 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.624933 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.625088 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.625170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.625320 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.625398 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.625550 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.625627 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.625775 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.625852 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.626000 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.626078 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.626227 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.626310 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.626455 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.626531 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.626680 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.626758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.626906 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.626981 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.627132 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.627208 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.627362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.627442 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.627589 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.627665 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.627848 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.627928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.628102 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.628185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.628337 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.628415 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.628562 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.external = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.628639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.628788 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.628866 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.external = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.629013 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.629089 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.629289 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.629375 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.629513 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.password = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.629592 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.629738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.token = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.629816 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.password = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.629966 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.token = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.630042 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.630194 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.630277 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.630425 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.630510 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.630650 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.630726 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.630885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.630962 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.631125 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.631203 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.631351 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.631430 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.631581 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.631661 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.631859 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.631930 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.632107 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.632174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.632421 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.632513 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.632660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.632741 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.632876 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.632963 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.633104 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.633210 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.633364 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.633442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.633611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.633686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.633841 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.633927 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.634089 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.634167 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.634364 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.634442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.634604 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.634682 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.634861 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.634940 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.635096 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.635174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.635346 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.635435 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.635575 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.635654 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.635829 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.635910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.636068 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.636157 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.636312 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.636389 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.636535 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.636614 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.636770 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.636854 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.636997 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.637074 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.637234 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.637311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.637463 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.637548 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.637705 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.637783 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.637935 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.638012 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.638175 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.638260 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.638404 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.638482 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.638633 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.638709 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.638872 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.638957 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.639099 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.639177 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.639329 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.639406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.639563 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.639648 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.639812 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.639891 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.640044 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.640122 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.640276 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.640364 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.640519 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.640597 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.640745 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.640822 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.640969 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.641055 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.641194 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.641276 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.641420 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.641496 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.641659 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.641744 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.641900 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.641977 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.642145 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.642224 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.642384 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.642476 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.642627 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.642705 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.642866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.642942 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.643096 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.643182 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.643320 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.643400 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.643546 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.643623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.643791 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.643888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.644024 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.644097 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.644253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.644337 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.644484 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.644562 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.644733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.644810 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.644981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.645059 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.645209 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.645288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.645453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.645531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.645695 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.645773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.645928 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.646007 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.646171 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.646248 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.646398 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.646476 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.646628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.646712 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.646850 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.646926 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.647077 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.647153 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.647333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.647439 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.647677 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.647791 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.647952 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.648051 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.648191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.648371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.648439 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.648627 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.648694 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.648872 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.648947 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.649100 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.649167 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.649328 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.649394 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.649571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.649645 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.649813 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.649880 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.650043 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.650110 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.650271 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.650345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.650502 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.650570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.650726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.650793 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.650960 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.651034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.651211 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.651278 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.651436 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.651502 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.651676 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.651774 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.651952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.652021 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.652194 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.652263 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.652426 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.652513 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.652653 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.652732 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.652883 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.652961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.653112 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.653246 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.653331 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.653556 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.653635 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.653796 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.653874 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.654037 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.654266 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.654344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.654503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.654609 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.654741 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.654855 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.654964 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.655118 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.655199 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.655345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.655430 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.655575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.655650 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.655826 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.655921 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.656062 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.656140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.656294 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.656373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.656525 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.656602 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.656756 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.656834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.656998 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.657077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.657222 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.657298 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.657460 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.657538 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.657691 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.657770 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.657920 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.657998 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.658151 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.658229 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.658383 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.658461 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.658615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.658693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.658839 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.658916 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.659070 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.659149 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.659304 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.659381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.659536 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.659645 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.659793 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.659914 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.660033 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.660148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.660380 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.660512 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.660629 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.660707 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.660858 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.660935 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.661100 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.661185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.661333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.661411 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.661567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.661643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.661796 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] role.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.661881 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.662037 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.662113 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] role.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.662261 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.662339 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.662493 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] role.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.662578 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.662734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.662812 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] role.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.663498 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.663582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.663766 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.663852 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.664015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.664241 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.664320 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.664486 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.664562 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.664729 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.664807 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.664956 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.665035 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.665197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.665274 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.665439 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.665519 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.665680 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.665758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.665910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.665986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.666157 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.666302 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.666402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.666535 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.666648 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.666786 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.666894 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.667031 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.667275 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.667352 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.667508 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.667592 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.667756 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.667836 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.668010 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.668088 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.668254 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.668343 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.668488 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.668565 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.668716 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.668794 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.668954 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.669040 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.669182 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.669261 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.669426 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.669504 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.669658 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.669745 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.669888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.669967 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.670120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.670197 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.670350 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.670437 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.670575 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.670656 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.670804 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] token.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.670882 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.671034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.671120 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.671277 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.671355 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.671504 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.671580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.671756 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] token.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.671852 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.671994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.672073 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.672225 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.672302 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.672461 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.672550 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.672705 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.672781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.672946 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.673023 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.673175 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.673263 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.673408 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.673487 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.673637 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.673715 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.673878 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.673971 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.674108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.674185 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.674330 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.674406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.674564 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.674649 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.674820 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.674898 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.675074 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.675152 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.675302 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.675389 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.675544 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.675623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.675795 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.675874 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.676034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.676111 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.676261 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.676344 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.676484 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.676565 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.676719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.676797 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.676949 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.677026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.677187 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.677266 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.677417 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.677495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.677654 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.677732 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.677883 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.677963 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.678123 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.678200 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.678351 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.678436 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.679202 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.679368 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.679432 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.679610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.679881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.679981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.680074 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 13:49:59.680149 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.680384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.680635 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.680865 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.681103 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.681336 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:49:59.681507 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 13:49:59.710897 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.711119 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.711335 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.712387 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.712623 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.712848 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.720304 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.721744 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.748795 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.749027 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.750314 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.750555 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.801936 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.802554 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.853691 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.853865 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.854487 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.854723 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.919405 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.919629 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.919743 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.919876 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.919963 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.920096 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.920196 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.920313 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.920397 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.920526 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.920609 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.920741 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.943874 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.944107 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.944842 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.944969 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.945074 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.945225 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.945303 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.945376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.945449 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.945572 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.945663 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.945786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.945869 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.945994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.956972 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.957165 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.969808 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.969961 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.970046 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.970189 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.970289 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.970409 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.970492 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.970626 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.970709 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.970858 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.970949 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.971067 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.971149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.971296 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:49:59.990270 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:49:59.990477 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 13:49:59.990735 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:49:59.990819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:49:59.990943 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 13:49:59.991578 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 13:49:59.991811 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:49:59.991935 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:49:59.992019 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 13:49:59.992260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:49:59.992341 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:49:59.992513 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:49:59.992607 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:49:59.992762 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:49:59.992843 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:49:59.993009 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.003824 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.003930 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.004098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.004205 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.004362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.004472 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.004635 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.004750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.013340 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.013436 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.016603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.016689 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.016880 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.016963 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.017156 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.017239 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.017434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.017526 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.017711 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.017793 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.017965 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.018047 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.018228 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.018317 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.018602 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.018683 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.018871 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.018950 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.019139 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.019220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.019405 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.019485 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.046358 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.046847 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.047971 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.048354 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.048478 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.048866 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.054195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.054650 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.054766 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.054993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.055074 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.055271 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.062560 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.062845 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.067315 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.067601 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.067912 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.068305 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.068583 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.068859 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.068940 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.069289 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.069417 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.070226 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.073944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.074227 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.074506 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.074894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.075169 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.075442 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.075731 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.075997 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.089017 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.089290 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.094245 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.094827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.095099 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.097899 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.098192 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.099785 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.103914 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.104031 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.104243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.107443 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.109423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.111095 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.111392 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.111828 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.112125 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.112403 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.112684 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.113018 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.117249 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.117539 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.117936 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.118229 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.118505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.118784 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.132403 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.132690 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.132956 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.133217 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.137696 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.137976 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.138240 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.138497 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.141404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.143116 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.143392 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.146470 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.146557 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.146749 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.147027 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.147561 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.147877 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.148243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.148520 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.151534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.151838 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.152118 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.152391 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.152658 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.161338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.161613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.161891 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.162176 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.162457 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.162740 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.163897 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.166670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.166943 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.167217 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.167490 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.167795 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.168076 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.168354 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.182127 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.185534 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.186622 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.188867 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.189995 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.190477 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.192121 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.192408 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.192696 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.193293 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.195007 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.196637 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.196918 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.197194 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.200111 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.201710 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.204525 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.205015 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.205302 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.205584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.205859 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.206111 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.209350 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.209636 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.210017 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.210481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.215156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.215445 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.215748 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.219798 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.220083 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.220359 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.224007 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.224284 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.224562 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.224837 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.225107 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.226072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.226531 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.226612 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.226873 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.227140 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.227406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.227665 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.227956 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.228215 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.228990 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:50:00.229267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.229541 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.229812 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.230083 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.230350 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.230633 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.230897 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.231160 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.231435 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.231697 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.231976 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.232244 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.232499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:50:00.267822 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55cc5bd359c0 pid: 80399 (default app) May 25 13:50:00.271062 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37561a-8f42-4241-826f-1e78e1778534 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:00.271358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37561a-8f42-4241-826f-1e78e1778534 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:00.271637 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37561a-8f42-4241-826f-1e78e1778534 None None] PATH_INFO: `/v3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:00.271884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55cc5bd359c0 pid: 80398 (default app) May 25 13:50:00.276207 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Wed May 25 13:50:00 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:08.993416 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b592087-40c6-4081-b7b7-6fccfc3c2bcc None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:08.993977 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b592087-40c6-4081-b7b7-6fccfc3c2bcc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:08.993977 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b592087-40c6-4081-b7b7-6fccfc3c2bcc None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:08.998347 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:09.003765 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446fadd-e498-43e5-a0f4-e888c948cb47 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:09.004185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446fadd-e498-43e5-a0f4-e888c948cb47 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:09.004328 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446fadd-e498-43e5-a0f4-e888c948cb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:09.074061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: INFO dbcounter [None req-1446fadd-e498-43e5-a0f4-e888c948cb47 None None] Registered counter for database keystone May 25 13:50:09.095605 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG oslo_db.sqlalchemy.engines [None req-1446fadd-e498-43e5-a0f4-e888c948cb47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 13:50:09.102331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writer thread running {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 13:50:09.277536 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG passlib.handlers.bcrypt [None req-1446fadd-e498-43e5-a0f4-e888c948cb47 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80399) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 13:50:09.277948 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG passlib.handlers.bcrypt [None req-1446fadd-e498-43e5-a0f4-e888c948cb47 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80399) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 13:50:09.334575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1446fadd-e498-43e5-a0f4-e888c948cb47 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:09.336276 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1446fadd-e498-43e5-a0f4-e888c948cb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:09.460206 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 25 13:50:09.646971 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b592087-40c6-4081-b7b7-6fccfc3c2bcc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:09.715982 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: INFO dbcounter [None req-5b592087-40c6-4081-b7b7-6fccfc3c2bcc None None] Registered counter for database keystone May 25 13:50:09.735929 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG oslo_db.sqlalchemy.engines [None req-5b592087-40c6-4081-b7b7-6fccfc3c2bcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 13:50:09.742086 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writer thread running {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 13:50:09.861659 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b592087-40c6-4081-b7b7-6fccfc3c2bcc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:09.865918 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ebd8d-b209-47fa-8066-dce2a34be561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a4f621a835a4791ab184efa095e7a24', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:09.866570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ebd8d-b209-47fa-8066-dce2a34be561 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:09.866880 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ebd8d-b209-47fa-8066-dce2a34be561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:09.867195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ebd8d-b209-47fa-8066-dce2a34be561 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:09.875314 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ebd8d-b209-47fa-8066-dce2a34be561 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:09.927780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c20ebd8d-b209-47fa-8066-dce2a34be561 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 13:50:09.928074 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ebd8d-b209-47fa-8066-dce2a34be561 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:09.938027 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Wed May 25 13:50:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 13:50:09.944187 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446fadd-e498-43e5-a0f4-e888c948cb47 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:09.959117 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446fadd-e498-43e5-a0f4-e888c948cb47 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:09.964305 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654ac82-fa7f-4583-9050-c652bc82859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a4f621a835a4791ab184efa095e7a24', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:09.965431 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654ac82-fa7f-4583-9050-c652bc82859d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:09.965719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654ac82-fa7f-4583-9050-c652bc82859d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:09.965997 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654ac82-fa7f-4583-9050-c652bc82859d admin admin] PATH_INFO: `/v3/projects/8a4f621a835a4791ab184efa095e7a24` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:09.967498 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654ac82-fa7f-4583-9050-c652bc82859d admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4f621a835a4791ab184efa095e7a24)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:10.128491 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7654ac82-fa7f-4583-9050-c652bc82859d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 13:50:10.129111 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654ac82-fa7f-4583-9050-c652bc82859d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:10.134865 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Wed May 25 13:50:09 2022] GET /identity/v3/projects/8a4f621a835a4791ab184efa095e7a24 => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:12.310699 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123defe-a6da-4eac-bf6c-30fb980f4c83 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:12.311109 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123defe-a6da-4eac-bf6c-30fb980f4c83 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:12.311248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123defe-a6da-4eac-bf6c-30fb980f4c83 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:12.315329 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:12.321131 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1bce2-6e1a-4ba7-ac13-025a6a1e3554 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:12.321551 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1bce2-6e1a-4ba7-ac13-025a6a1e3554 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:12.321692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1bce2-6e1a-4ba7-ac13-025a6a1e3554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:12.340961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-61f1bce2-6e1a-4ba7-ac13-025a6a1e3554 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:12.342470 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-61f1bce2-6e1a-4ba7-ac13-025a6a1e3554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:12.350505 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 13:50:12.372998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123defe-a6da-4eac-bf6c-30fb980f4c83 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:12.385693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123defe-a6da-4eac-bf6c-30fb980f4c83 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:12.389895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91808dc4-cf38-4af4-9482-4bace08ea662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a4f621a835a4791ab184efa095e7a24', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:12.390522 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91808dc4-cf38-4af4-9482-4bace08ea662 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:12.390810 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91808dc4-cf38-4af4-9482-4bace08ea662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:12.391097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91808dc4-cf38-4af4-9482-4bace08ea662 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:12.399443 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91808dc4-cf38-4af4-9482-4bace08ea662 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:12.401254 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91808dc4-cf38-4af4-9482-4bace08ea662 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:12.410012 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Wed May 25 13:50:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 13:50:12.415268 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1bce2-6e1a-4ba7-ac13-025a6a1e3554 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:12.424448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1bce2-6e1a-4ba7-ac13-025a6a1e3554 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:12.428927 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9df554-3fac-4025-9562-70977d69b333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a4f621a835a4791ab184efa095e7a24', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:12.430552 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9df554-3fac-4025-9562-70977d69b333 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:12.430828 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9df554-3fac-4025-9562-70977d69b333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:12.431100 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9df554-3fac-4025-9562-70977d69b333 admin admin] PATH_INFO: `/v3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:12.432499 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9df554-3fac-4025-9562-70977d69b333 admin admin] RBAC: Authorizing `identity:get_user(user_id=10eec1f5d0fc4da09d1b4c7f6fd362eb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:12.434317 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9df554-3fac-4025-9562-70977d69b333 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:12.435890 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Wed May 25 13:50:12 2022] GET /identity/v3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:14.702439 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b803-60b4-4b70-b4ff-c18bc9cc0623 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:14.702923 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b803-60b4-4b70-b4ff-c18bc9cc0623 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:14.702923 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b803-60b4-4b70-b4ff-c18bc9cc0623 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:14.704297 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:14.707039 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4c87b-7b5f-44ac-bfaa-655659227af7 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:14.707442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4c87b-7b5f-44ac-bfaa-655659227af7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:14.707612 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4c87b-7b5f-44ac-bfaa-655659227af7 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:14.709054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:14.709174 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070eb03-c2f1-4621-b138-555c459a89b8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:14.709459 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070eb03-c2f1-4621-b138-555c459a89b8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:14.709737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070eb03-c2f1-4621-b138-555c459a89b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:14.714812 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d6da6-18f9-42a3-930e-598a62590070 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:14.715104 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d6da6-18f9-42a3-930e-598a62590070 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:14.715391 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d6da6-18f9-42a3-930e-598a62590070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:14.732613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-182d6da6-18f9-42a3-930e-598a62590070 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:14.733811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-182d6da6-18f9-42a3-930e-598a62590070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:14.750089 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG passlib.handlers.bcrypt [None req-9070eb03-c2f1-4621-b138-555c459a89b8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80398) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 13:50:14.750517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG passlib.handlers.bcrypt [None req-9070eb03-c2f1-4621-b138-555c459a89b8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80398) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 13:50:14.797027 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9070eb03-c2f1-4621-b138-555c459a89b8 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:14.798589 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9070eb03-c2f1-4621-b138-555c459a89b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:14.812428 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 7/12] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:50:14.834094 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d6da6-18f9-42a3-930e-598a62590070 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:14.859088 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:14.902420 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 6/13] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:50:14.925149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070eb03-c2f1-4621-b138-555c459a89b8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:14.941936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d6da6-18f9-42a3-930e-598a62590070 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:14.976210 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd463bcf-a558-4f7a-9e34-67cd76c1031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:14.976807 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd463bcf-a558-4f7a-9e34-67cd76c1031a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:14.977173 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd463bcf-a558-4f7a-9e34-67cd76c1031a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:14.977454 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd463bcf-a558-4f7a-9e34-67cd76c1031a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:15.049963 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd463bcf-a558-4f7a-9e34-67cd76c1031a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:15.051472 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd463bcf-a558-4f7a-9e34-67cd76c1031a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:15.076620 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:15.135845 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070eb03-c2f1-4621-b138-555c459a89b8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:15.138882 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:15.152527 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 8/14] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:50:15.158086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd463bcf-a558-4f7a-9e34-67cd76c1031a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:15.173951 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe127-ee64-4f36-8177-09cc7d8ba635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:15.174995 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe127-ee64-4f36-8177-09cc7d8ba635 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:15.175281 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe127-ee64-4f36-8177-09cc7d8ba635 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:15.175561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe127-ee64-4f36-8177-09cc7d8ba635 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:15.187695 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbe127-ee64-4f36-8177-09cc7d8ba635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-85cbe127-ee64-4f36-8177-09cc7d8ba635 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:15.199456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:15.200570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:15.201366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:15.201366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:15.201366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:15.201366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:15.201366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:15.201366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:15.201366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:15.201366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:15.201366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:15.201366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:15.201366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:15.201366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:15.201366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 7/15] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:50:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:50:15.206393 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe127-ee64-4f36-8177-09cc7d8ba635 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:15.255530 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd463bcf-a558-4f7a-9e34-67cd76c1031a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:15.278666 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:15.292004 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882577-689c-4fb0-ae82-2ff2f0413a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:15.292802 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882577-689c-4fb0-ae82-2ff2f0413a82 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:15.293085 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882577-689c-4fb0-ae82-2ff2f0413a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:15.293361 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882577-689c-4fb0-ae82-2ff2f0413a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:15.303295 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45882577-689c-4fb0-ae82-2ff2f0413a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:15.304946 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45882577-689c-4fb0-ae82-2ff2f0413a82 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:15.310190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe127-ee64-4f36-8177-09cc7d8ba635 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-45882577-689c-4fb0-ae82-2ff2f0413a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:50:15.326438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:15.327447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:15.328276 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:50:15.328276 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:50:15.328276 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:50:15.328276 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:15.328276 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 9/16] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:50:15.333387 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882577-689c-4fb0-ae82-2ff2f0413a82 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:15.345433 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eca28-0805-41b0-b5c5-c203b975e720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:15.346104 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eca28-0805-41b0-b5c5-c203b975e720 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:15.346391 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eca28-0805-41b0-b5c5-c203b975e720 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:15.346668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eca28-0805-41b0-b5c5-c203b975e720 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:15.347421 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42eca28-0805-41b0-b5c5-c203b975e720 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:15.347753 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42eca28-0805-41b0-b5c5-c203b975e720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:15.349207 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42eca28-0805-41b0-b5c5-c203b975e720 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:15.361765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 8/17] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:15.367962 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eca28-0805-41b0-b5c5-c203b975e720 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:15.394759 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:15.432903 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882577-689c-4fb0-ae82-2ff2f0413a82 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:15.466941 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f9dcc-3e32-4947-bbdc-2b435d451379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:15.467111 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eca28-0805-41b0-b5c5-c203b975e720 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:15.467875 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f9dcc-3e32-4947-bbdc-2b435d451379 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:15.468157 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f9dcc-3e32-4947-bbdc-2b435d451379 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:15.468432 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f9dcc-3e32-4947-bbdc-2b435d451379 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:15.469151 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f9dcc-3e32-4947-bbdc-2b435d451379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:15.469457 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f9dcc-3e32-4947-bbdc-2b435d451379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:15.470851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f9dcc-3e32-4947-bbdc-2b435d451379 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:15.487578 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:15.501260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff81365-4f86-4fe0-b965-fb79f6110118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:15.502157 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff81365-4f86-4fe0-b965-fb79f6110118 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:15.502440 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff81365-4f86-4fe0-b965-fb79f6110118 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:15.502716 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff81365-4f86-4fe0-b965-fb79f6110118 None admin] PATH_INFO: `/v3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:15.504396 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff81365-4f86-4fe0-b965-fb79f6110118 None admin] RBAC: Authorizing `identity:get_user(user_id=10eec1f5d0fc4da09d1b4c7f6fd362eb)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:15.505969 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff81365-4f86-4fe0-b965-fb79f6110118 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:15.508496 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:15 2022] GET /identity/v3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:15.514514 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f9dcc-3e32-4947-bbdc-2b435d451379 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:15.552841 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:15.626797 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f9dcc-3e32-4947-bbdc-2b435d451379 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:15.662785 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12874314-bc8d-4d7c-aa91-b748112a6910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:15.663689 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12874314-bc8d-4d7c-aa91-b748112a6910 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:15.664005 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12874314-bc8d-4d7c-aa91-b748112a6910 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:15.664295 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12874314-bc8d-4d7c-aa91-b748112a6910 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:15.665552 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12874314-bc8d-4d7c-aa91-b748112a6910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:15.667017 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12874314-bc8d-4d7c-aa91-b748112a6910 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:15.668653 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:15.674467 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff81365-4f86-4fe0-b965-fb79f6110118 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:15.773835 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:15.780489 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff81365-4f86-4fe0-b965-fb79f6110118 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:15.816609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00758180-b38b-469c-af06-c4f09e61c5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:15.817273 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00758180-b38b-469c-af06-c4f09e61c5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:15.817558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00758180-b38b-469c-af06-c4f09e61c5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:15.817832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00758180-b38b-469c-af06-c4f09e61c5c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:15.818666 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00758180-b38b-469c-af06-c4f09e61c5c0 None admin] RBAC: Adding query filter params (role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5, scope.domain.id=default, user.id=10eec1f5d0fc4da09d1b4c7f6fd362eb) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:15.818982 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00758180-b38b-469c-af06-c4f09e61c5c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:15.821178 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00758180-b38b-469c-af06-c4f09e61c5c0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:15.830222 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1322 bytes} [Wed May 25 13:50:15 2022] GET /identity/v3/role_assignments?user.id=10eec1f5d0fc4da09d1b4c7f6fd362eb&scope.domain.id=default&role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5 => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:18.055314 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f101e1-45b8-4837-b1b5-8ed56381176a None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:18.055864 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f101e1-45b8-4837-b1b5-8ed56381176a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:18.055939 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f101e1-45b8-4837-b1b5-8ed56381176a None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:18.057252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:18.070185 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a10f1-885f-4788-a1ca-efa8c962d282 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:18.070608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a10f1-885f-4788-a1ca-efa8c962d282 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:18.070740 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a10f1-885f-4788-a1ca-efa8c962d282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:18.097248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-236a10f1-885f-4788-a1ca-efa8c962d282 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:18.098446 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-236a10f1-885f-4788-a1ca-efa8c962d282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:18.156077 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3890580-2087-4ad2-a936-8f32249a7436 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:18.156454 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3890580-2087-4ad2-a936-8f32249a7436 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:18.156646 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3890580-2087-4ad2-a936-8f32249a7436 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:18.157978 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 13/23] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:50:18.164028 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc76e1-3aec-4994-a230-e41b8c9ffa54 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:18.164504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc76e1-3aec-4994-a230-e41b8c9ffa54 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:18.164865 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc76e1-3aec-4994-a230-e41b8c9ffa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:18.197037 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-85cc76e1-3aec-4994-a230-e41b8c9ffa54 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:18.198533 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-85cc76e1-3aec-4994-a230-e41b8c9ffa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:18.205456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 11/24] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:18.258919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a10f1-885f-4788-a1ca-efa8c962d282 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:18.325637 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 14/25] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:50:18.364532 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc76e1-3aec-4994-a230-e41b8c9ffa54 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:18.425055 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:18.480100 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:18.514715 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a10f1-885f-4788-a1ca-efa8c962d282 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:18.556196 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc76e1-3aec-4994-a230-e41b8c9ffa54 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:18.617109 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf3a12-f469-45ce-917d-bf01ab55128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:18.617864 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3a12-f469-45ce-917d-bf01ab55128f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:18.618138 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3a12-f469-45ce-917d-bf01ab55128f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:18.618415 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3a12-f469-45ce-917d-bf01ab55128f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:18.640437 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25b3ed-255c-4bb0-974b-004522d7fed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:18.641125 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25b3ed-255c-4bb0-974b-004522d7fed0 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:18.641414 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25b3ed-255c-4bb0-974b-004522d7fed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:18.641696 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25b3ed-255c-4bb0-974b-004522d7fed0 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:18.642455 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25b3ed-255c-4bb0-974b-004522d7fed0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:18.643898 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25b3ed-255c-4bb0-974b-004522d7fed0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:18.653143 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf3a12-f469-45ce-917d-bf01ab55128f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:18.654647 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf3a12-f469-45ce-917d-bf01ab55128f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-37bf3a12-f469-45ce-917d-bf01ab55128f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:50:18.677822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:18.678682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:18.680033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:50:18.680033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:50:18.680033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:50:18.680033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:18.680033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 12/26] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:18.681569 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0cd23-a282-43b0-89eb-f4d407ed8388 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:18.681569 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0cd23-a282-43b0-89eb-f4d407ed8388 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:18.681812 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0cd23-a282-43b0-89eb-f4d407ed8388 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:18.683650 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:18.686630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0cd23-a282-43b0-89eb-f4d407ed8388 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:18.808469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0cd23-a282-43b0-89eb-f4d407ed8388 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:18.913774 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 15/28] 10.222.0.43 () {60 vars in 1131 bytes} [Wed May 25 13:50:18 2022] POST /identity/v3/roles => generated 219 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:50:18.915695 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8676cb0-544b-4a07-b759-061e4949bb08 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:18.916152 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8676cb0-544b-4a07-b759-061e4949bb08 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:18.916592 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8676cb0-544b-4a07-b759-061e4949bb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:18.919528 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed955a-228b-407d-b179-9e13c0139480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:18.920244 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed955a-228b-407d-b179-9e13c0139480 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:18.920532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed955a-228b-407d-b179-9e13c0139480 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:18.920809 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed955a-228b-407d-b179-9e13c0139480 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:18.921556 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed955a-228b-407d-b179-9e13c0139480 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:18.921865 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed955a-228b-407d-b179-9e13c0139480 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:18.923456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed955a-228b-407d-b179-9e13c0139480 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:18.937711 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b8676cb0-544b-4a07-b759-061e4949bb08 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:18.939591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b8676cb0-544b-4a07-b759-061e4949bb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:18.956087 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:18.965852 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 14/29] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:18.971817 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed955a-228b-407d-b179-9e13c0139480 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:19.024147 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 16/30] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:19.058895 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8676cb0-544b-4a07-b759-061e4949bb08 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:19.089050 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:19.155824 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed955a-228b-407d-b179-9e13c0139480 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:19.186513 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8676cb0-544b-4a07-b759-061e4949bb08 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:19.204392 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fbf27-1aa9-448a-9a08-2bbb1736c224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:19.205069 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fbf27-1aa9-448a-9a08-2bbb1736c224 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:19.205354 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fbf27-1aa9-448a-9a08-2bbb1736c224 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:19.205628 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fbf27-1aa9-448a-9a08-2bbb1736c224 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:19.206376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fbf27-1aa9-448a-9a08-2bbb1736c224 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:19.207916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fbf27-1aa9-448a-9a08-2bbb1736c224 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:19.255331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b48d3e-b5d4-4459-8d33-5e3591aa588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:19.256260 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b48d3e-b5d4-4459-8d33-5e3591aa588b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:19.256551 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b48d3e-b5d4-4459-8d33-5e3591aa588b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:19.260280 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b48d3e-b5d4-4459-8d33-5e3591aa588b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:19.270577 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b48d3e-b5d4-4459-8d33-5e3591aa588b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c5b48d3e-b5d4-4459-8d33-5e3591aa588b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:19.279819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:19.280714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:19.281466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:19.281466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:19.281466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:19.281466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:19.281466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:19.281466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:19.281466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:19.281466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:19.281466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:19.281466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:19.281466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:19.281466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:19.281466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 17/31] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:50:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:50:19.282919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b710a-e4e5-4eba-ae36-1edfc8a87014 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:19.282919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b710a-e4e5-4eba-ae36-1edfc8a87014 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:19.283091 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b710a-e4e5-4eba-ae36-1edfc8a87014 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:19.284502 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 18/32] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:19.292707 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561be54-94a1-492d-a15d-80422dc4b128 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:19.292707 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561be54-94a1-492d-a15d-80422dc4b128 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:19.292707 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561be54-94a1-492d-a15d-80422dc4b128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:19.314084 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c561be54-94a1-492d-a15d-80422dc4b128 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:19.315273 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c561be54-94a1-492d-a15d-80422dc4b128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:19.405277 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 19/33] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:50:19.406360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561be54-94a1-492d-a15d-80422dc4b128 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:19.428067 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:19.462230 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 15/34] 10.222.0.43 () {60 vars in 1141 bytes} [Wed May 25 13:50:18 2022] POST /identity/v3/projects => generated 301 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:50:19.463119 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fbf27-1aa9-448a-9a08-2bbb1736c224 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:19.581987 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:19.603740 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561be54-94a1-492d-a15d-80422dc4b128 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:19.681309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bb502-25b0-4c5c-9089-825747adc6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:19.682027 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bb502-25b0-4c5c-9089-825747adc6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:19.682295 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bb502-25b0-4c5c-9089-825747adc6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:19.682576 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bb502-25b0-4c5c-9089-825747adc6b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:19.683578 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bb502-25b0-4c5c-9089-825747adc6b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:19.683927 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bb502-25b0-4c5c-9089-825747adc6b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:19.685575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bb502-25b0-4c5c-9089-825747adc6b5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:19.691746 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fbf27-1aa9-448a-9a08-2bbb1736c224 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:19.706229 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 20/35] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:19.713794 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bb502-25b0-4c5c-9089-825747adc6b5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:19.743235 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8689892-8b73-4427-933e-af612ce7309c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:19.743954 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8689892-8b73-4427-933e-af612ce7309c None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:19.744252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8689892-8b73-4427-933e-af612ce7309c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:19.744535 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8689892-8b73-4427-933e-af612ce7309c None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:19.745376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8689892-8b73-4427-933e-af612ce7309c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:19.746973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8689892-8b73-4427-933e-af612ce7309c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:19.821638 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:19.827976 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 16/36] 10.222.0.43 () {60 vars in 1131 bytes} [Wed May 25 13:50:19 2022] POST /identity/v3/roles => generated 225 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:19.829456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8cfa1-7e69-47de-b6c1-aa4dff1abf68 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:19.829983 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8cfa1-7e69-47de-b6c1-aa4dff1abf68 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:19.830269 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8cfa1-7e69-47de-b6c1-aa4dff1abf68 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:19.831593 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 17/37] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:19.837297 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797aedb-9350-482c-b0fb-7a4bc7eb3c21 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:19.837698 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797aedb-9350-482c-b0fb-7a4bc7eb3c21 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:19.838058 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797aedb-9350-482c-b0fb-7a4bc7eb3c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:19.850432 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bb502-25b0-4c5c-9089-825747adc6b5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:19.858281 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b797aedb-9350-482c-b0fb-7a4bc7eb3c21 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:19.860323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b797aedb-9350-482c-b0fb-7a4bc7eb3c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:19.895958 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83d372-d55e-481a-9ba2-7193a5229781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:19.896859 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d372-d55e-481a-9ba2-7193a5229781 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:19.897150 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d372-d55e-481a-9ba2-7193a5229781 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:19.897433 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d372-d55e-481a-9ba2-7193a5229781 None admin] PATH_INFO: `/v3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:19.899448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83d372-d55e-481a-9ba2-7193a5229781 None admin] RBAC: Authorizing `identity:get_user(user_id=10eec1f5d0fc4da09d1b4c7f6fd362eb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:19.901011 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83d372-d55e-481a-9ba2-7193a5229781 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:19.902978 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 21/38] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:19 2022] GET /identity/v3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:19.904146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8c237-09b2-44e2-8f30-aa50ecb9407c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:19.904443 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8c237-09b2-44e2-8f30-aa50ecb9407c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:19.904728 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8c237-09b2-44e2-8f30-aa50ecb9407c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:19.906510 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 22/39] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:19.908850 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8c237-09b2-44e2-8f30-aa50ecb9407c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:19.951764 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 18/40] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:50:19.957203 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73300c8d-d430-41ef-a33e-7f3d6e6f2a58 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:19.957484 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73300c8d-d430-41ef-a33e-7f3d6e6f2a58 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:19.957766 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73300c8d-d430-41ef-a33e-7f3d6e6f2a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:19.979119 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-73300c8d-d430-41ef-a33e-7f3d6e6f2a58 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:19.980347 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-73300c8d-d430-41ef-a33e-7f3d6e6f2a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:20.024011 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:20.030129 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8c237-09b2-44e2-8f30-aa50ecb9407c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:20.063918 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 19/41] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:20.064868 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73300c8d-d430-41ef-a33e-7f3d6e6f2a58 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:20.081262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b96e6-9569-4b98-8d5e-74bb40e81612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:20.082760 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b96e6-9569-4b98-8d5e-74bb40e81612 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:20.083051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b96e6-9569-4b98-8d5e-74bb40e81612 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:20.083430 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b96e6-9569-4b98-8d5e-74bb40e81612 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:20.084569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b96e6-9569-4b98-8d5e-74bb40e81612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:20.086580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b96e6-9569-4b98-8d5e-74bb40e81612 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:20.088833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 23/42] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:20.089444 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b96e6-9569-4b98-8d5e-74bb40e81612 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:20.105878 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:20.176664 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73300c8d-d430-41ef-a33e-7f3d6e6f2a58 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:20.192532 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b96e6-9569-4b98-8d5e-74bb40e81612 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:20.211646 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9afee5-4d12-4db3-b510-057e11896fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:20.212469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9afee5-4d12-4db3-b510-057e11896fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:20.212758 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9afee5-4d12-4db3-b510-057e11896fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:20.213039 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9afee5-4d12-4db3-b510-057e11896fd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:20.214229 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9afee5-4d12-4db3-b510-057e11896fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:20.215684 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9afee5-4d12-4db3-b510-057e11896fd1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:20.217600 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 20/43] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:20.218342 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9afee5-4d12-4db3-b510-057e11896fd1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:20.227888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cb2b6-48a1-4102-97a8-c4c445dbed2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:20.228552 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cb2b6-48a1-4102-97a8-c4c445dbed2e None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:20.228838 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cb2b6-48a1-4102-97a8-c4c445dbed2e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:20.229113 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cb2b6-48a1-4102-97a8-c4c445dbed2e None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:20.229900 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cb2b6-48a1-4102-97a8-c4c445dbed2e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:20.231246 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cb2b6-48a1-4102-97a8-c4c445dbed2e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:20.263487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:20.299376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 24/44] 10.222.0.43 () {60 vars in 1131 bytes} [Wed May 25 13:50:20 2022] POST /identity/v3/roles => generated 223 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:20.300329 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cb2b6-48a1-4102-97a8-c4c445dbed2e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:20.326513 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9afee5-4d12-4db3-b510-057e11896fd1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:20.374181 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987eae03-cb7f-4f3e-b790-a0c485878c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:20.375190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eae03-cb7f-4f3e-b790-a0c485878c4a None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:20.375500 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eae03-cb7f-4f3e-b790-a0c485878c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:20.375830 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eae03-cb7f-4f3e-b790-a0c485878c4a None admin] PATH_INFO: `/v3/domains/default/users/10eec1f5d0fc4da09d1b4c7f6fd362eb/roles/cc4e2e441e3a4f67a7b4ed50677ecaa5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:20.378044 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987eae03-cb7f-4f3e-b790-a0c485878c4a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=10eec1f5d0fc4da09d1b4c7f6fd362eb, role_id=cc4e2e441e3a4f67a7b4ed50677ecaa5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:20.379540 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987eae03-cb7f-4f3e-b790-a0c485878c4a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:20.385908 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:20.419423 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cb2b6-48a1-4102-97a8-c4c445dbed2e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:20.455486 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b16c5d-bf49-4160-8778-20a26848fa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:20.456197 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b16c5d-bf49-4160-8778-20a26848fa6d None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:20.456492 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b16c5d-bf49-4160-8778-20a26848fa6d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:20.456775 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b16c5d-bf49-4160-8778-20a26848fa6d None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:20.457501 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b16c5d-bf49-4160-8778-20a26848fa6d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:20.459174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b16c5d-bf49-4160-8778-20a26848fa6d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:20.461594 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 21/45] 10.222.0.43 () {58 vars in 1361 bytes} [Wed May 25 13:50:20 2022] PUT /identity/v3/domains/default/users/10eec1f5d0fc4da09d1b4c7f6fd362eb/roles/cc4e2e441e3a4f67a7b4ed50677ecaa5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:20.543677 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 25/46] 10.222.0.43 () {60 vars in 1141 bytes} [Wed May 25 13:50:20 2022] POST /identity/v3/projects => generated 312 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:22.648886 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9657b05-3268-4a20-aff5-8dd9304a6cd1 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:22.649377 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9657b05-3268-4a20-aff5-8dd9304a6cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:22.649377 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9657b05-3268-4a20-aff5-8dd9304a6cd1 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:22.650765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 22/47] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:22.656205 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388320a-6c59-4be2-8635-4656dd951c34 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:22.656602 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388320a-6c59-4be2-8635-4656dd951c34 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:22.656897 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388320a-6c59-4be2-8635-4656dd951c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:22.673479 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7388320a-6c59-4be2-8635-4656dd951c34 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:22.674664 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7388320a-6c59-4be2-8635-4656dd951c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:22.739886 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 26/48] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:22.763490 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9657b05-3268-4a20-aff5-8dd9304a6cd1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:22.778546 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa681c40-93c3-440d-8791-00c84b47c116 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:22.778842 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa681c40-93c3-440d-8791-00c84b47c116 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:22.779130 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa681c40-93c3-440d-8791-00c84b47c116 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:22.780702 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 27/49] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:50:22.785609 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde76392-a685-4187-ab1c-11079a5511a1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:22.785906 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde76392-a685-4187-ab1c-11079a5511a1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:22.786540 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde76392-a685-4187-ab1c-11079a5511a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:22.803241 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-dde76392-a685-4187-ab1c-11079a5511a1 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:22.804562 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dde76392-a685-4187-ab1c-11079a5511a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:22.850944 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:22.863823 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:22.867790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9657b05-3268-4a20-aff5-8dd9304a6cd1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:22.870299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 28/50] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:50:22.894066 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde76392-a685-4187-ab1c-11079a5511a1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:22.902577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d115dc-3182-42ee-a6cc-54a4ce714e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:22.903313 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d115dc-3182-42ee-a6cc-54a4ce714e42 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:22.903606 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d115dc-3182-42ee-a6cc-54a4ce714e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:22.903922 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d115dc-3182-42ee-a6cc-54a4ce714e42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:22.915061 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d115dc-3182-42ee-a6cc-54a4ce714e42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-95d115dc-3182-42ee-a6cc-54a4ce714e42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:22.922737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:22.923611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:22.924422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:22.924422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:22.924422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:22.924422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:22.924422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:22.924422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:22.924422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:22.924422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:22.924422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:22.924422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:22.924422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:22.924422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:22.924422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 23/51] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:50:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:22.930461 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d115dc-3182-42ee-a6cc-54a4ce714e42 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:22.995854 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde76392-a685-4187-ab1c-11079a5511a1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:23.029176 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926efc3-cec8-4bad-afc2-65e8cb06c99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:23.029971 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926efc3-cec8-4bad-afc2-65e8cb06c99c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:23.030258 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926efc3-cec8-4bad-afc2-65e8cb06c99c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:23.030536 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926efc3-cec8-4bad-afc2-65e8cb06c99c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:23.031727 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926efc3-cec8-4bad-afc2-65e8cb06c99c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:23.033219 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926efc3-cec8-4bad-afc2-65e8cb06c99c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:23.033363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d115dc-3182-42ee-a6cc-54a4ce714e42 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:23.034836 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 29/52] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:23.041550 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926efc3-cec8-4bad-afc2-65e8cb06c99c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:23.068448 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcda04-0603-4994-a972-8a254f819654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:23.069126 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcda04-0603-4994-a972-8a254f819654 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:23.070101 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcda04-0603-4994-a972-8a254f819654 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:23.070429 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcda04-0603-4994-a972-8a254f819654 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:23.071187 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcda04-0603-4994-a972-8a254f819654 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:23.071501 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcda04-0603-4994-a972-8a254f819654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:23.072939 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcda04-0603-4994-a972-8a254f819654 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:23.081349 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 24/53] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:23.086731 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcda04-0603-4994-a972-8a254f819654 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:23.094468 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:23.111502 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:23.144472 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926efc3-cec8-4bad-afc2-65e8cb06c99c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:23.176867 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb44473-3c6c-4644-a898-7df09f2a3033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:23.177461 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb44473-3c6c-4644-a898-7df09f2a3033 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:23.177747 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb44473-3c6c-4644-a898-7df09f2a3033 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:23.178035 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb44473-3c6c-4644-a898-7df09f2a3033 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:23.179457 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb44473-3c6c-4644-a898-7df09f2a3033 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:23.180935 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb44473-3c6c-4644-a898-7df09f2a3033 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:23.186999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcda04-0603-4994-a972-8a254f819654 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:23.221203 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891e9f7-36f5-4b39-9fbc-3eb1b0f640d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:23.222077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891e9f7-36f5-4b39-9fbc-3eb1b0f640d4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:23.222363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891e9f7-36f5-4b39-9fbc-3eb1b0f640d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:23.222646 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891e9f7-36f5-4b39-9fbc-3eb1b0f640d4 None admin] PATH_INFO: `/v3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:23.223867 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891e9f7-36f5-4b39-9fbc-3eb1b0f640d4 None admin] RBAC: Authorizing `identity:get_user(user_id=10eec1f5d0fc4da09d1b4c7f6fd362eb)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:23.225303 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891e9f7-36f5-4b39-9fbc-3eb1b0f640d4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:23.227081 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 25/54] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:23 2022] GET /identity/v3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:23.232341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891e9f7-36f5-4b39-9fbc-3eb1b0f640d4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:23.272739 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 30/55] 10.222.0.43 () {60 vars in 1140 bytes} [Wed May 25 13:50:23 2022] POST /identity/v3/projects => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:50:23.332892 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:23.344144 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891e9f7-36f5-4b39-9fbc-3eb1b0f640d4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:23.383679 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955e68b-672e-41a1-bce7-e4309adf4e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:23.384525 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955e68b-672e-41a1-bce7-e4309adf4e3e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:23.384817 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955e68b-672e-41a1-bce7-e4309adf4e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:23.385101 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955e68b-672e-41a1-bce7-e4309adf4e3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:23.386328 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955e68b-672e-41a1-bce7-e4309adf4e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:23.387825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955e68b-672e-41a1-bce7-e4309adf4e3e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:23.389499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 26/56] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:23.395544 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb44473-3c6c-4644-a898-7df09f2a3033 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:23.499967 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb44473-3c6c-4644-a898-7df09f2a3033 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:23.501455 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:23.535456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dc8de-8195-4979-affe-0b77c120fed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:23.536139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dc8de-8195-4979-affe-0b77c120fed4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:23.536426 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dc8de-8195-4979-affe-0b77c120fed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:23.536706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dc8de-8195-4979-affe-0b77c120fed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:23.537540 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90dc8de-8195-4979-affe-0b77c120fed4 None admin] RBAC: Adding query filter params (role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5, scope.domain.id=default, user.id=10eec1f5d0fc4da09d1b4c7f6fd362eb) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:23.537910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90dc8de-8195-4979-affe-0b77c120fed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:23.539395 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90dc8de-8195-4979-affe-0b77c120fed4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:23.546808 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 31/57] 10.222.0.43 () {56 vars in 1322 bytes} [Wed May 25 13:50:23 2022] GET /identity/v3/role_assignments?user.id=10eec1f5d0fc4da09d1b4c7f6fd362eb&scope.domain.id=default&role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:25.503674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252701b7-66bd-4511-b20b-21bfec4170f8 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:25.504221 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252701b7-66bd-4511-b20b-21bfec4170f8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:25.504316 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252701b7-66bd-4511-b20b-21bfec4170f8 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:25.505619 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 27/58] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:25.511446 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67390f-5d86-465f-8214-031e19772bc4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:25.511885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67390f-5d86-465f-8214-031e19772bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:25.512051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67390f-5d86-465f-8214-031e19772bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:25.528462 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7d67390f-5d86-465f-8214-031e19772bc4 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:25.529654 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7d67390f-5d86-465f-8214-031e19772bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:25.596150 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 32/59] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:25.621290 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252701b7-66bd-4511-b20b-21bfec4170f8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:25.720025 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252701b7-66bd-4511-b20b-21bfec4170f8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:25.758130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6f965-4559-4ea6-8d99-c705a9cae6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:25.760248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6f965-4559-4ea6-8d99-c705a9cae6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:25.760539 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6f965-4559-4ea6-8d99-c705a9cae6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:25.760820 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6f965-4559-4ea6-8d99-c705a9cae6a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:25.762005 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6f965-4559-4ea6-8d99-c705a9cae6a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:25.763453 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6f965-4559-4ea6-8d99-c705a9cae6a7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:25.765114 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 28/60] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:25.770647 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67390f-5d86-465f-8214-031e19772bc4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:25.862420 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:25.868487 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67390f-5d86-465f-8214-031e19772bc4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:25.900930 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8c4fd-30c2-40d3-a233-c03bcca5b7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:25.901586 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8c4fd-30c2-40d3-a233-c03bcca5b7d0 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:25.901868 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8c4fd-30c2-40d3-a233-c03bcca5b7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:25.902142 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8c4fd-30c2-40d3-a233-c03bcca5b7d0 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:25.902853 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8c4fd-30c2-40d3-a233-c03bcca5b7d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:25.904533 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8c4fd-30c2-40d3-a233-c03bcca5b7d0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:26.014269 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 33/61] 10.222.0.43 () {60 vars in 1132 bytes} [Wed May 25 13:50:25 2022] POST /identity/v3/users => generated 275 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:50:29.275823 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd783ab8-16d1-43dd-87af-1e13b35c1045 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.275823 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd783ab8-16d1-43dd-87af-1e13b35c1045 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.275823 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd783ab8-16d1-43dd-87af-1e13b35c1045 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.277638 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 29/62] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:29.283369 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a7ed3-9124-40c4-8b48-b098234a2662 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.284347 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a7ed3-9124-40c4-8b48-b098234a2662 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.284829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a7ed3-9124-40c4-8b48-b098234a2662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.308765 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9f4a7ed3-9124-40c4-8b48-b098234a2662 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:29.309976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9f4a7ed3-9124-40c4-8b48-b098234a2662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:29.394215 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 34/63] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:29.441331 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd783ab8-16d1-43dd-87af-1e13b35c1045 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.462133 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb182792-db7a-4959-8896-a1f9f2f4d713 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.481603 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb182792-db7a-4959-8896-a1f9f2f4d713 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.481603 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb182792-db7a-4959-8896-a1f9f2f4d713 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.481603 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 35/64] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:29.481603 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24a347-eced-42bc-9df3-1bdbbda04ac0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.481603 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24a347-eced-42bc-9df3-1bdbbda04ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.481603 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24a347-eced-42bc-9df3-1bdbbda04ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.498399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-cd24a347-eced-42bc-9df3-1bdbbda04ac0 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:29.499582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cd24a347-eced-42bc-9df3-1bdbbda04ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:29.508084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:29.624857 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 36/65] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:50:29.639905 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd783ab8-16d1-43dd-87af-1e13b35c1045 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.659296 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24a347-eced-42bc-9df3-1bdbbda04ac0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.677446 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:29.701746 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4a6dc-79ae-47f0-9aba-43db9c1031bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.702946 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a6dc-79ae-47f0-9aba-43db9c1031bf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.707878 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a6dc-79ae-47f0-9aba-43db9c1031bf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.708350 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a6dc-79ae-47f0-9aba-43db9c1031bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.723925 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4a6dc-79ae-47f0-9aba-43db9c1031bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e6e4a6dc-79ae-47f0-9aba-43db9c1031bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:29.735623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:29.736543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:29.737311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:29.737311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:29.737311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:29.737311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:29.737311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:29.737311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:29.737311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:29.737311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:29.737311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:29.737311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:29.737311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:29.737311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:29.739969 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 30/66] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:29.742145 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8bfb5-aba2-45fd-bc99-dc5f2b349b49 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.742920 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8bfb5-aba2-45fd-bc99-dc5f2b349b49 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.743418 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8bfb5-aba2-45fd-bc99-dc5f2b349b49 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.744990 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 31/67] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:29.750168 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8bfb5-aba2-45fd-bc99-dc5f2b349b49 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.788931 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24a347-eced-42bc-9df3-1bdbbda04ac0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.825937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce3d3a-8e27-4bd7-ad44-551ce03d8e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.827615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce3d3a-8e27-4bd7-ad44-551ce03d8e2f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.828115 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce3d3a-8e27-4bd7-ad44-551ce03d8e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.828552 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce3d3a-8e27-4bd7-ad44-551ce03d8e2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.842308 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce3d3a-8e27-4bd7-ad44-551ce03d8e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-0cce3d3a-8e27-4bd7-ad44-551ce03d8e2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:29.852456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:29.853399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:29.854171 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:29.854171 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:29.854171 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:29.854171 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:29.854171 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:29.854171 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:29.854171 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:29.854171 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:29.854171 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:29.854171 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:29.854171 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:29.854171 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:29.854746 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:29.859938 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 37/68] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:50:29.859938 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08dabf-e3e9-4617-8fc8-1ceb11b3a7c2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.859938 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08dabf-e3e9-4617-8fc8-1ceb11b3a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.859938 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08dabf-e3e9-4617-8fc8-1ceb11b3a7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.870798 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8bfb5-aba2-45fd-bc99-dc5f2b349b49 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.878246 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ed08dabf-e3e9-4617-8fc8-1ceb11b3a7c2 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:29.879381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ed08dabf-e3e9-4617-8fc8-1ceb11b3a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:29.911451 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b551b-b776-423a-ab2f-5a73a5de94d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.912492 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b551b-b776-423a-ab2f-5a73a5de94d1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.912882 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b551b-b776-423a-ab2f-5a73a5de94d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.913403 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b551b-b776-423a-ab2f-5a73a5de94d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.914204 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b551b-b776-423a-ab2f-5a73a5de94d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:29.914520 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b551b-b776-423a-ab2f-5a73a5de94d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.915954 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b551b-b776-423a-ab2f-5a73a5de94d1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.924707 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 32/69] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:29.926006 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bfe77-8310-49f9-8109-5f2e155d1de2 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.926304 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bfe77-8310-49f9-8109-5f2e155d1de2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.926589 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bfe77-8310-49f9-8109-5f2e155d1de2 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.927868 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 33/70] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:29.929458 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bfe77-8310-49f9-8109-5f2e155d1de2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.957647 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 38/71] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:29.964920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08dabf-e3e9-4617-8fc8-1ceb11b3a7c2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.968740 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:30.049856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bfe77-8310-49f9-8109-5f2e155d1de2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.078663 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08dabf-e3e9-4617-8fc8-1ceb11b3a7c2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.088980 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6926fa-213f-46dd-921d-44c5c562b4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.089469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6926fa-213f-46dd-921d-44c5c562b4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.089763 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6926fa-213f-46dd-921d-44c5c562b4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.090048 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6926fa-213f-46dd-921d-44c5c562b4f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.090802 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6926fa-213f-46dd-921d-44c5c562b4f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:30.091120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6926fa-213f-46dd-921d-44c5c562b4f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.092803 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6926fa-213f-46dd-921d-44c5c562b4f8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.104222 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 34/72] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:30.105693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfff284-12a2-4cc1-91c7-f232574192e8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.105991 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfff284-12a2-4cc1-91c7-f232574192e8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.106273 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfff284-12a2-4cc1-91c7-f232574192e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.122805 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-abfff284-12a2-4cc1-91c7-f232574192e8 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:30.123264 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793e66e-f855-49f0-aeab-f3526f6ce05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.124042 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-abfff284-12a2-4cc1-91c7-f232574192e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:30.124235 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793e66e-f855-49f0-aeab-f3526f6ce05b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.124524 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793e66e-f855-49f0-aeab-f3526f6ce05b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.124862 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793e66e-f855-49f0-aeab-f3526f6ce05b None admin] PATH_INFO: `/v3/users/f9ffced892d5405fac25fca222a9eb25` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.127667 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:30.142895 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793e66e-f855-49f0-aeab-f3526f6ce05b None admin] RBAC: Authorizing `identity:get_user(user_id=f9ffced892d5405fac25fca222a9eb25)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.144965 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793e66e-f855-49f0-aeab-f3526f6ce05b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.148011 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 39/73] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/users/f9ffced892d5405fac25fca222a9eb25 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:30.149349 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793e66e-f855-49f0-aeab-f3526f6ce05b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.199745 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 35/74] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:30.200617 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfff284-12a2-4cc1-91c7-f232574192e8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.223858 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:30.264997 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793e66e-f855-49f0-aeab-f3526f6ce05b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.301211 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33261149-4643-4758-9ea0-bc77850398af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.302012 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33261149-4643-4758-9ea0-bc77850398af None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.302295 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33261149-4643-4758-9ea0-bc77850398af None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.302573 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33261149-4643-4758-9ea0-bc77850398af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.309999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfff284-12a2-4cc1-91c7-f232574192e8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.313181 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33261149-4643-4758-9ea0-bc77850398af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-33261149-4643-4758-9ea0-bc77850398af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:30.321448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:30.322500 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:30.323281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:30.323281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:30.323281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:30.323281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:30.323281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:30.323281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:30.323281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:30.323281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:30.323281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:30.323281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:30.323281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:50:30.323281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:30.323281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 40/75] 10.222.0.43 () {56 vars in 1114 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:30.325059 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33261149-4643-4758-9ea0-bc77850398af None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.346002 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c2391-5cdf-480e-b3bf-53986886ca18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.346884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c2391-5cdf-480e-b3bf-53986886ca18 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.347169 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c2391-5cdf-480e-b3bf-53986886ca18 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.347449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c2391-5cdf-480e-b3bf-53986886ca18 None admin] PATH_INFO: `/v3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.348683 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c2391-5cdf-480e-b3bf-53986886ca18 None admin] RBAC: Authorizing `identity:get_user(user_id=10eec1f5d0fc4da09d1b4c7f6fd362eb)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.350721 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c2391-5cdf-480e-b3bf-53986886ca18 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.352439 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 36/76] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:30.353689 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f35242-cfdd-4165-bc1d-eb78922da53b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.353980 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f35242-cfdd-4165-bc1d-eb78922da53b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.354267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f35242-cfdd-4165-bc1d-eb78922da53b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.355504 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 37/77] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:30.356239 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f35242-cfdd-4165-bc1d-eb78922da53b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.367919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:30.430336 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33261149-4643-4758-9ea0-bc77850398af None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.449726 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:30.460320 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f35242-cfdd-4165-bc1d-eb78922da53b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.464746 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95890492-0978-4900-89ef-a80aa7388e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.465400 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95890492-0978-4900-89ef-a80aa7388e57 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.465690 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95890492-0978-4900-89ef-a80aa7388e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.465973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95890492-0978-4900-89ef-a80aa7388e57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.496087 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59865577-4c1e-4caf-9548-0aa173a68c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.496884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59865577-4c1e-4caf-9548-0aa173a68c43 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.497175 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59865577-4c1e-4caf-9548-0aa173a68c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.497463 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59865577-4c1e-4caf-9548-0aa173a68c43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.508720 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59865577-4c1e-4caf-9548-0aa173a68c43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-59865577-4c1e-4caf-9548-0aa173a68c43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:30.516447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:30.517507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:30.518278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:30.518278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:30.518278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:30.518278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:30.518278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:30.518278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:30.518278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:30.518278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:30.518278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:30.518278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:30.518278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:30.518278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:30.518278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 38/78] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:30.519059 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59865577-4c1e-4caf-9548-0aa173a68c43 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.539534 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95890492-0978-4900-89ef-a80aa7388e57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.541066 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95890492-0978-4900-89ef-a80aa7388e57 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.586132 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:30.621363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59865577-4c1e-4caf-9548-0aa173a68c43 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.638684 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 41/79] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:50:30.639526 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95890492-0978-4900-89ef-a80aa7388e57 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.656381 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a401d5a-f849-428f-a06d-1cfba2c4334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.657056 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401d5a-f849-428f-a06d-1cfba2c4334d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.657346 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401d5a-f849-428f-a06d-1cfba2c4334d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.657630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401d5a-f849-428f-a06d-1cfba2c4334d None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.658384 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a401d5a-f849-428f-a06d-1cfba2c4334d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:30.658701 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a401d5a-f849-428f-a06d-1cfba2c4334d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.660114 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a401d5a-f849-428f-a06d-1cfba2c4334d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.661799 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:30.668674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 39/80] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:30.669960 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182db3e-d9d5-4a49-bd01-805f4d82040c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.673909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182db3e-d9d5-4a49-bd01-805f4d82040c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.673909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182db3e-d9d5-4a49-bd01-805f4d82040c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.686835 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4182db3e-d9d5-4a49-bd01-805f4d82040c None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:30.687996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4182db3e-d9d5-4a49-bd01-805f4d82040c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:30.739932 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95890492-0978-4900-89ef-a80aa7388e57 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.754744 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 40/81] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:30.755588 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182db3e-d9d5-4a49-bd01-805f4d82040c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.785017 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60cda4-c5cb-4cf9-8fc1-41d4c94cf14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.785681 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60cda4-c5cb-4cf9-8fc1-41d4c94cf14f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.785965 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60cda4-c5cb-4cf9-8fc1-41d4c94cf14f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.786244 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60cda4-c5cb-4cf9-8fc1-41d4c94cf14f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.815960 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:30.852954 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60cda4-c5cb-4cf9-8fc1-41d4c94cf14f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.854456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60cda4-c5cb-4cf9-8fc1-41d4c94cf14f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.857549 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182db3e-d9d5-4a49-bd01-805f4d82040c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.874642 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:30.890928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3560169-0a45-42cf-aace-7e91d2cf6c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.891602 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3560169-0a45-42cf-aace-7e91d2cf6c1a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.891923 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3560169-0a45-42cf-aace-7e91d2cf6c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.892203 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3560169-0a45-42cf-aace-7e91d2cf6c1a None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.892945 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3560169-0a45-42cf-aace-7e91d2cf6c1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:30.893253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3560169-0a45-42cf-aace-7e91d2cf6c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.894635 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3560169-0a45-42cf-aace-7e91d2cf6c1a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.909021 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 41/82] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:30.909021 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3560169-0a45-42cf-aace-7e91d2cf6c1a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.954329 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 42/83] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:50:30.955104 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60cda4-c5cb-4cf9-8fc1-41d4c94cf14f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.008449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3560169-0a45-42cf-aace-7e91d2cf6c1a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.031044 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:31.042930 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cb3c4-d464-4e77-9818-5c9bca0bff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.043845 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cb3c4-d464-4e77-9818-5c9bca0bff4e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.044178 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cb3c4-d464-4e77-9818-5c9bca0bff4e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.044517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cb3c4-d464-4e77-9818-5c9bca0bff4e None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.045729 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cb3c4-d464-4e77-9818-5c9bca0bff4e None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.047191 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cb3c4-d464-4e77-9818-5c9bca0bff4e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.049091 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 42/84] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:31.049873 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cb3c4-d464-4e77-9818-5c9bca0bff4e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.056168 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60cda4-c5cb-4cf9-8fc1-41d4c94cf14f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.075689 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:31.089039 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb9564-b41f-4c6f-8e0a-231c436efe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.089909 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9564-b41f-4c6f-8e0a-231c436efe77 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.090191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9564-b41f-4c6f-8e0a-231c436efe77 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.090466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9564-b41f-4c6f-8e0a-231c436efe77 None admin] PATH_INFO: `/v3/users/f9ffced892d5405fac25fca222a9eb25` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.091639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb9564-b41f-4c6f-8e0a-231c436efe77 None admin] RBAC: Authorizing `identity:get_user(user_id=f9ffced892d5405fac25fca222a9eb25)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.093405 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb9564-b41f-4c6f-8e0a-231c436efe77 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.095018 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 43/85] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/users/f9ffced892d5405fac25fca222a9eb25 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:31.095865 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb9564-b41f-4c6f-8e0a-231c436efe77 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.152258 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cb3c4-d464-4e77-9818-5c9bca0bff4e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.186150 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69f621-840a-4339-a407-0e3542f372fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.186945 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69f621-840a-4339-a407-0e3542f372fa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.187244 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69f621-840a-4339-a407-0e3542f372fa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.187527 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69f621-840a-4339-a407-0e3542f372fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.188746 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69f621-840a-4339-a407-0e3542f372fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.190203 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69f621-840a-4339-a407-0e3542f372fa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.191924 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 43/86] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:31.192692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69f621-840a-4339-a407-0e3542f372fa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.198751 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb9564-b41f-4c6f-8e0a-231c436efe77 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.231653 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5f97-3968-46ad-afd4-aad25e2a540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.232480 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5f97-3968-46ad-afd4-aad25e2a540b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.232757 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5f97-3968-46ad-afd4-aad25e2a540b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.233027 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5f97-3968-46ad-afd4-aad25e2a540b None admin] PATH_INFO: `/v3/users/f9ffced892d5405fac25fca222a9eb25` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.234203 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a5f97-3968-46ad-afd4-aad25e2a540b None admin] RBAC: Authorizing `identity:get_user(user_id=f9ffced892d5405fac25fca222a9eb25)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.235655 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a5f97-3968-46ad-afd4-aad25e2a540b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.237303 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 44/87] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:31 2022] GET /identity/v3/users/f9ffced892d5405fac25fca222a9eb25 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:31.238051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5f97-3968-46ad-afd4-aad25e2a540b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.253813 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:31.294624 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:31.298495 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69f621-840a-4339-a407-0e3542f372fa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.332782 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666482fd-bb73-4f81-953c-bc8a1987cdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.333644 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666482fd-bb73-4f81-953c-bc8a1987cdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.333929 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666482fd-bb73-4f81-953c-bc8a1987cdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.334211 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666482fd-bb73-4f81-953c-bc8a1987cdb2 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.335412 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666482fd-bb73-4f81-953c-bc8a1987cdb2 None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.336894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666482fd-bb73-4f81-953c-bc8a1987cdb2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.338584 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 44/88] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:31 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:31.339349 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666482fd-bb73-4f81-953c-bc8a1987cdb2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.340118 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5f97-3968-46ad-afd4-aad25e2a540b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.375447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d73f0-76ac-4549-ab05-163de029f731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.376180 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d73f0-76ac-4549-ab05-163de029f731 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.376473 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d73f0-76ac-4549-ab05-163de029f731 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.376752 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d73f0-76ac-4549-ab05-163de029f731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.377586 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d73f0-76ac-4549-ab05-163de029f731 None admin] RBAC: Adding query filter params (role.id=997ba13b80634887b0a7e88cbf2b2e62, scope.project.id=66a86bd19c83439885fcd12d7fb788d3, user.id=f9ffced892d5405fac25fca222a9eb25) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:31.377905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d73f0-76ac-4549-ab05-163de029f731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.379393 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d73f0-76ac-4549-ab05-163de029f731 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.385627 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 45/89] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:31 2022] GET /identity/v3/role_assignments?user.id=f9ffced892d5405fac25fca222a9eb25&scope.project.id=66a86bd19c83439885fcd12d7fb788d3&role.id=997ba13b80634887b0a7e88cbf2b2e62 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:31.386409 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d73f0-76ac-4549-ab05-163de029f731 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.455854 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666482fd-bb73-4f81-953c-bc8a1987cdb2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.485084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:31.494881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee253389-0185-4ced-a23a-ea4bffd38867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.495542 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee253389-0185-4ced-a23a-ea4bffd38867 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.495858 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee253389-0185-4ced-a23a-ea4bffd38867 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.496138 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee253389-0185-4ced-a23a-ea4bffd38867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.504372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d73f0-76ac-4549-ab05-163de029f731 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.527295 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:31.542578 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2879895-9acd-41fc-9baa-3d39b77ffe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.543272 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2879895-9acd-41fc-9baa-3d39b77ffe05 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.543558 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2879895-9acd-41fc-9baa-3d39b77ffe05 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.543874 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2879895-9acd-41fc-9baa-3d39b77ffe05 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.544601 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2879895-9acd-41fc-9baa-3d39b77ffe05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.546124 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2879895-9acd-41fc-9baa-3d39b77ffe05 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.572868 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee253389-0185-4ced-a23a-ea4bffd38867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.574468 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee253389-0185-4ced-a23a-ea4bffd38867 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.611744 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 46/90] 10.222.0.43 () {60 vars in 1132 bytes} [Wed May 25 13:50:31 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:31.611744 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2879895-9acd-41fc-9baa-3d39b77ffe05 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.703749 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 45/91] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:50:31.704937 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee253389-0185-4ced-a23a-ea4bffd38867 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.744035 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:31.755043 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2879895-9acd-41fc-9baa-3d39b77ffe05 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.796697 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c240a26-2e80-4bbd-80ad-889f1b1fd8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.796697 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c240a26-2e80-4bbd-80ad-889f1b1fd8ec None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.797177 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c240a26-2e80-4bbd-80ad-889f1b1fd8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.797550 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c240a26-2e80-4bbd-80ad-889f1b1fd8ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.844420 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee253389-0185-4ced-a23a-ea4bffd38867 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.860202 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:31.883621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4b25e-086a-4d3a-933d-d88952a17987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.883992 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c240a26-2e80-4bbd-80ad-889f1b1fd8ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.884340 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b25e-086a-4d3a-933d-d88952a17987 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.884633 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b25e-086a-4d3a-933d-d88952a17987 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.884920 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b25e-086a-4d3a-933d-d88952a17987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.885513 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c240a26-2e80-4bbd-80ad-889f1b1fd8ec None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.885762 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4b25e-086a-4d3a-933d-d88952a17987 None admin] RBAC: Adding query filter params (role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5, scope.project.id=66a86bd19c83439885fcd12d7fb788d3, user.id=10eec1f5d0fc4da09d1b4c7f6fd362eb) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:31.886083 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4b25e-086a-4d3a-933d-d88952a17987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.887555 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4b25e-086a-4d3a-933d-d88952a17987 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.896153 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 46/92] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:31 2022] GET /identity/v3/role_assignments?user.id=10eec1f5d0fc4da09d1b4c7f6fd362eb&scope.project.id=66a86bd19c83439885fcd12d7fb788d3&role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:31.896926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4b25e-086a-4d3a-933d-d88952a17987 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:32.021034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:32.021353 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 47/93] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:50:32.027599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c240a26-2e80-4bbd-80ad-889f1b1fd8ec None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:32.038346 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4b25e-086a-4d3a-933d-d88952a17987 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:32.080567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c2819-9608-4eca-836d-62f7d5442a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:32.081466 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c2819-9608-4eca-836d-62f7d5442a7f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.081851 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c2819-9608-4eca-836d-62f7d5442a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.082128 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c2819-9608-4eca-836d-62f7d5442a7f None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.083998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c2819-9608-4eca-836d-62f7d5442a7f None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:32.086015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c2819-9608-4eca-836d-62f7d5442a7f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:32.088158 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 47/94] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:31 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:32.097852 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c2819-9608-4eca-836d-62f7d5442a7f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:32.159401 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:32.191972 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c240a26-2e80-4bbd-80ad-889f1b1fd8ec None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:32.233577 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98741d-4f89-441a-83f6-373419472aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:32.234835 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98741d-4f89-441a-83f6-373419472aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.235313 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c2819-9608-4eca-836d-62f7d5442a7f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:32.235528 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98741d-4f89-441a-83f6-373419472aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.236910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98741d-4f89-441a-83f6-373419472aa5 None admin] PATH_INFO: `/v3/projects/8f9fd18fa95f432aa5746937ce1a4a5c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.238395 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98741d-4f89-441a-83f6-373419472aa5 None admin] RBAC: Authorizing `identity:get_project(project_id=8f9fd18fa95f432aa5746937ce1a4a5c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:32.240113 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98741d-4f89-441a-83f6-373419472aa5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:32.242680 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 48/95] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:32 2022] GET /identity/v3/projects/8f9fd18fa95f432aa5746937ce1a4a5c => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:32.248518 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98741d-4f89-441a-83f6-373419472aa5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:32.285756 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f337f8-9a73-4a00-b292-5de8e06fad68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:32.287271 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f337f8-9a73-4a00-b292-5de8e06fad68 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.287271 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f337f8-9a73-4a00-b292-5de8e06fad68 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.288048 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f337f8-9a73-4a00-b292-5de8e06fad68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.288865 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f337f8-9a73-4a00-b292-5de8e06fad68 None admin] RBAC: Adding query filter params (role.id=9ba48b8364e040eb829f7c1e7662f8d3, scope.project.id=66a86bd19c83439885fcd12d7fb788d3, user.id=f9ffced892d5405fac25fca222a9eb25) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:32.289185 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f337f8-9a73-4a00-b292-5de8e06fad68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:32.291195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f337f8-9a73-4a00-b292-5de8e06fad68 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:32.297530 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 48/96] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:32 2022] GET /identity/v3/role_assignments?user.id=f9ffced892d5405fac25fca222a9eb25&scope.project.id=66a86bd19c83439885fcd12d7fb788d3&role.id=9ba48b8364e040eb829f7c1e7662f8d3 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:32.399155 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98741d-4f89-441a-83f6-373419472aa5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:32.451402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262d25c-7349-4db7-93e9-aa13a70592fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:32.452522 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262d25c-7349-4db7-93e9-aa13a70592fa None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.453060 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262d25c-7349-4db7-93e9-aa13a70592fa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.453535 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262d25c-7349-4db7-93e9-aa13a70592fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.454604 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262d25c-7349-4db7-93e9-aa13a70592fa None admin] RBAC: Adding query filter params (role.id=997ba13b80634887b0a7e88cbf2b2e62, scope.project.id=8f9fd18fa95f432aa5746937ce1a4a5c, user.id=f9ffced892d5405fac25fca222a9eb25) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:32.455163 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262d25c-7349-4db7-93e9-aa13a70592fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:32.457758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262d25c-7349-4db7-93e9-aa13a70592fa None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:32.465859 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 49/97] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:32 2022] GET /identity/v3/role_assignments?user.id=f9ffced892d5405fac25fca222a9eb25&scope.project.id=8f9fd18fa95f432aa5746937ce1a4a5c&role.id=997ba13b80634887b0a7e88cbf2b2e62 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:34.404723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df80ab3-9fe7-4908-8310-c8b0df786b37 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:34.405744 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df80ab3-9fe7-4908-8310-c8b0df786b37 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:34.406260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df80ab3-9fe7-4908-8310-c8b0df786b37 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:34.407851 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 49/98] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:34.413886 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230d22a-b8fa-462e-af65-3793cd1308d6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:34.414330 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230d22a-b8fa-462e-af65-3793cd1308d6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:34.414505 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230d22a-b8fa-462e-af65-3793cd1308d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:34.437685 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3230d22a-b8fa-462e-af65-3793cd1308d6 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:34.438889 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3230d22a-b8fa-462e-af65-3793cd1308d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:34.441010 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:34.537866 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 50/99] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:34.572874 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df80ab3-9fe7-4908-8310-c8b0df786b37 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:34.607742 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:34.716100 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df80ab3-9fe7-4908-8310-c8b0df786b37 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:34.762561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa6474-43aa-4ce5-9af8-594b1b7e537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:34.763732 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa6474-43aa-4ce5-9af8-594b1b7e537f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:34.764237 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa6474-43aa-4ce5-9af8-594b1b7e537f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:34.764722 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa6474-43aa-4ce5-9af8-594b1b7e537f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:34.781715 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa6474-43aa-4ce5-9af8-594b1b7e537f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2efa6474-43aa-4ce5-9af8-594b1b7e537f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:34.790505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:34.791341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:34.796618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:34.796618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:34.796618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:34.796618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:34.796618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:34.796618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:34.796618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:34.796618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:34.796618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:34.796618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:34.796618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:34.796618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:34.797469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 50/100] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:34.804738 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230d22a-b8fa-462e-af65-3793cd1308d6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:34.925830 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230d22a-b8fa-462e-af65-3793cd1308d6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:34.962578 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de382d2e-1386-4e7d-b346-20de77c1177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:34.963270 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de382d2e-1386-4e7d-b346-20de77c1177d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:34.963558 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de382d2e-1386-4e7d-b346-20de77c1177d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:34.963869 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de382d2e-1386-4e7d-b346-20de77c1177d None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:34.964628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de382d2e-1386-4e7d-b346-20de77c1177d None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:34.964939 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de382d2e-1386-4e7d-b346-20de77c1177d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:34.966363 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de382d2e-1386-4e7d-b346-20de77c1177d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:34.972343 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:34.976627 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 51/101] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:34.977332 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972b312-9b32-4de1-9e09-0c0afc80fcba None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:34.977630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972b312-9b32-4de1-9e09-0c0afc80fcba None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:34.977918 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972b312-9b32-4de1-9e09-0c0afc80fcba None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:34.979401 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 51/102] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:34.982350 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de382d2e-1386-4e7d-b346-20de77c1177d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:34.995110 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92148a75-7f8b-4b6f-8bbb-38c0c4152ef7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:34.995409 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92148a75-7f8b-4b6f-8bbb-38c0c4152ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:34.995680 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92148a75-7f8b-4b6f-8bbb-38c0c4152ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.041925 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-92148a75-7f8b-4b6f-8bbb-38c0c4152ef7 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:35.043133 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-92148a75-7f8b-4b6f-8bbb-38c0c4152ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:35.141159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de382d2e-1386-4e7d-b346-20de77c1177d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.183015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 52/103] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:35.205426 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b313c0-adbb-4418-b981-d2a0f883d717 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.205715 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b313c0-adbb-4418-b981-d2a0f883d717 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.206002 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b313c0-adbb-4418-b981-d2a0f883d717 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.207504 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 53/104] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:50:35.213998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4ddb-f064-4c30-bd8d-651caa976647 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.214347 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4ddb-f064-4c30-bd8d-651caa976647 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.214563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4ddb-f064-4c30-bd8d-651caa976647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.214987 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8928fc-aec0-4fc3-b6dd-64ddb76f5d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:35.215909 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8928fc-aec0-4fc3-b6dd-64ddb76f5d23 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.216200 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8928fc-aec0-4fc3-b6dd-64ddb76f5d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.216722 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8928fc-aec0-4fc3-b6dd-64ddb76f5d23 None admin] PATH_INFO: `/v3/users/f9ffced892d5405fac25fca222a9eb25` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.220538 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8928fc-aec0-4fc3-b6dd-64ddb76f5d23 None admin] RBAC: Authorizing `identity:get_user(user_id=f9ffced892d5405fac25fca222a9eb25)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:35.222053 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8928fc-aec0-4fc3-b6dd-64ddb76f5d23 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:35.224154 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 52/105] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:34 2022] GET /identity/v3/users/f9ffced892d5405fac25fca222a9eb25 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:35.225123 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8928fc-aec0-4fc3-b6dd-64ddb76f5d23 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:35.241473 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ae5e4ddb-f064-4c30-bd8d-651caa976647 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:35.242752 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ae5e4ddb-f064-4c30-bd8d-651caa976647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:35.268092 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:35.298368 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:35.362739 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8928fc-aec0-4fc3-b6dd-64ddb76f5d23 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.405062 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931054d-e852-4f78-ac3b-5c9c21f3ef26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:35.406182 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931054d-e852-4f78-ac3b-5c9c21f3ef26 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.406490 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931054d-e852-4f78-ac3b-5c9c21f3ef26 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.406777 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931054d-e852-4f78-ac3b-5c9c21f3ef26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.418009 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 54/106] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:50:35.418492 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931054d-e852-4f78-ac3b-5c9c21f3ef26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:35.419930 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4ddb-f064-4c30-bd8d-651caa976647 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-6931054d-e852-4f78-ac3b-5c9c21f3ef26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:35.426327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:35.427185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:35.428081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:35.428081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:35.428081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:35.428081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:35.428081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:35.428081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:35.428081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:35.428081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:35.428081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:35.428081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:35.428081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:50:35.428081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:35.428081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 53/107] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:35.437154 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931054d-e852-4f78-ac3b-5c9c21f3ef26 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:35.599191 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4ddb-f064-4c30-bd8d-651caa976647 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.652712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931054d-e852-4f78-ac3b-5c9c21f3ef26 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.674444 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21d467-fcf7-4b0a-895e-27090bb4e8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:35.675678 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21d467-fcf7-4b0a-895e-27090bb4e8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.676183 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21d467-fcf7-4b0a-895e-27090bb4e8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.676658 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21d467-fcf7-4b0a-895e-27090bb4e8b7 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.678822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21d467-fcf7-4b0a-895e-27090bb4e8b7 None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:35.681975 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21d467-fcf7-4b0a-895e-27090bb4e8b7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:35.685105 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 55/108] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:35 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:35.686088 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21d467-fcf7-4b0a-895e-27090bb4e8b7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:35.704428 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:35.708076 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:35.717961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1898b-9b9f-4e02-8c1f-e7bf40868708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:35.718645 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1898b-9b9f-4e02-8c1f-e7bf40868708 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.718937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1898b-9b9f-4e02-8c1f-e7bf40868708 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.719220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1898b-9b9f-4e02-8c1f-e7bf40868708 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.720087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1898b-9b9f-4e02-8c1f-e7bf40868708 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:35.723910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1898b-9b9f-4e02-8c1f-e7bf40868708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:35.723910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1898b-9b9f-4e02-8c1f-e7bf40868708 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:35.732812 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 54/109] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:35.733779 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1898b-9b9f-4e02-8c1f-e7bf40868708 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:35.807398 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21d467-fcf7-4b0a-895e-27090bb4e8b7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.844553 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c61a9f-74f7-4366-a10b-7a05522a28c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:35.845454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c61a9f-74f7-4366-a10b-7a05522a28c3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.845811 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c61a9f-74f7-4366-a10b-7a05522a28c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.845904 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1898b-9b9f-4e02-8c1f-e7bf40868708 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.846164 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c61a9f-74f7-4366-a10b-7a05522a28c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.847434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c61a9f-74f7-4366-a10b-7a05522a28c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:35.848993 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c61a9f-74f7-4366-a10b-7a05522a28c3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:35.856449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 56/110] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:35.856449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae798b-1882-4539-81b6-df2d6ee21e0b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.856449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae798b-1882-4539-81b6-df2d6ee21e0b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.856449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae798b-1882-4539-81b6-df2d6ee21e0b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.856449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 57/111] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:35.856449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae798b-1882-4539-81b6-df2d6ee21e0b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:35.892141 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396720a9-1aa0-4718-b44b-6a4c69b8ba3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:35.893035 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396720a9-1aa0-4718-b44b-6a4c69b8ba3e None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.893322 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396720a9-1aa0-4718-b44b-6a4c69b8ba3e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.893601 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396720a9-1aa0-4718-b44b-6a4c69b8ba3e None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3/users/f9ffced892d5405fac25fca222a9eb25/roles/997ba13b80634887b0a7e88cbf2b2e62` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.895788 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396720a9-1aa0-4718-b44b-6a4c69b8ba3e None admin] RBAC: Authorizing `identity:create_grant(project_id=66a86bd19c83439885fcd12d7fb788d3, user_id=f9ffced892d5405fac25fca222a9eb25, role_id=997ba13b80634887b0a7e88cbf2b2e62)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:35.897149 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396720a9-1aa0-4718-b44b-6a4c69b8ba3e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:35.940866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:35.957720 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 55/112] 10.222.0.43 () {58 vars in 1439 bytes} [Wed May 25 13:50:35 2022] PUT /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3/users/f9ffced892d5405fac25fca222a9eb25/roles/997ba13b80634887b0a7e88cbf2b2e62 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:35.959298 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3695-ed23-4454-a781-7c5b512831c2 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.959943 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3695-ed23-4454-a781-7c5b512831c2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.960355 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3695-ed23-4454-a781-7c5b512831c2 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.962780 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 56/113] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:35.964886 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae798b-1882-4539-81b6-df2d6ee21e0b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.969452 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d3695-ed23-4454-a781-7c5b512831c2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:36.010086 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32f2ce-5b8a-4295-a504-ed02efc667d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:36.010978 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32f2ce-5b8a-4295-a504-ed02efc667d6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.011263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32f2ce-5b8a-4295-a504-ed02efc667d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.011546 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32f2ce-5b8a-4295-a504-ed02efc667d6 None admin] PATH_INFO: `/v3/users/0b14190ea479428f9261f7330cd53b7f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.028179 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:36.029075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32f2ce-5b8a-4295-a504-ed02efc667d6 None admin] RBAC: Authorizing `identity:get_user(user_id=0b14190ea479428f9261f7330cd53b7f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:36.030586 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32f2ce-5b8a-4295-a504-ed02efc667d6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:36.032444 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 58/114] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:35 2022] GET /identity/v3/users/0b14190ea479428f9261f7330cd53b7f => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:36.033706 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e05d4-c4cb-478e-9ca9-56addc2e054d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.033998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e05d4-c4cb-478e-9ca9-56addc2e054d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.034275 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e05d4-c4cb-478e-9ca9-56addc2e054d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.054777 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0d3e05d4-c4cb-478e-9ca9-56addc2e054d None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:36.056091 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0d3e05d4-c4cb-478e-9ca9-56addc2e054d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:36.105651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d3695-ed23-4454-a781-7c5b512831c2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:36.144017 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 59/115] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:36.145365 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cf74c-ad06-4877-8cfa-30b0d201c8eb None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.145661 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cf74c-ad06-4877-8cfa-30b0d201c8eb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.145945 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cf74c-ad06-4877-8cfa-30b0d201c8eb None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.148847 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 60/116] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:36.149245 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5c7a9-32c2-477b-97b9-782a8633fae5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.149530 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5c7a9-32c2-477b-97b9-782a8633fae5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.149810 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5c7a9-32c2-477b-97b9-782a8633fae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.152452 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af6525-37ec-4658-88dd-bcadde2a6553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:36.153455 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af6525-37ec-4658-88dd-bcadde2a6553 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.153992 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af6525-37ec-4658-88dd-bcadde2a6553 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.154499 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af6525-37ec-4658-88dd-bcadde2a6553 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.155480 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af6525-37ec-4658-88dd-bcadde2a6553 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:36.157239 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af6525-37ec-4658-88dd-bcadde2a6553 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:36.171656 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-99c5c7a9-32c2-477b-97b9-782a8633fae5 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:36.172969 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-99c5c7a9-32c2-477b-97b9-782a8633fae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:36.221163 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 57/117] 10.222.0.43 () {60 vars in 1141 bytes} [Wed May 25 13:50:35 2022] POST /identity/v3/projects => generated 302 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:36.222271 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af6525-37ec-4658-88dd-bcadde2a6553 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:36.251527 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:36.265033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 61/118] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:36.267615 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc144-5694-4757-abe8-0ff5f02ab6b4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.268127 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc144-5694-4757-abe8-0ff5f02ab6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.268588 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc144-5694-4757-abe8-0ff5f02ab6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.302307 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-131bc144-5694-4757-abe8-0ff5f02ab6b4 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:36.304717 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-131bc144-5694-4757-abe8-0ff5f02ab6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:36.354645 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af6525-37ec-4658-88dd-bcadde2a6553 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:36.356623 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:36.400277 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 62/119] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:36.401026 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bc144-5694-4757-abe8-0ff5f02ab6b4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:36.404409 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16012993-d763-48a9-9d90-635cf9950b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:36.405391 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16012993-d763-48a9-9d90-635cf9950b86 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.405888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16012993-d763-48a9-9d90-635cf9950b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.406366 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16012993-d763-48a9-9d90-635cf9950b86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.497583 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16012993-d763-48a9-9d90-635cf9950b86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:36.499086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16012993-d763-48a9-9d90-635cf9950b86 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:36.539142 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bc144-5694-4757-abe8-0ff5f02ab6b4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:36.573965 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:36.587981 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170ce82-1262-499b-9f47-cbf70fcbdaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:36.589999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170ce82-1262-499b-9f47-cbf70fcbdaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.590297 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170ce82-1262-499b-9f47-cbf70fcbdaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.590570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170ce82-1262-499b-9f47-cbf70fcbdaf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.607524 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170ce82-1262-499b-9f47-cbf70fcbdaf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:36.616497 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 58/120] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:50:36.617198 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16012993-d763-48a9-9d90-635cf9950b86 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:36.619595 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8170ce82-1262-499b-9f47-cbf70fcbdaf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:36.622084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:36.622996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:36.624279 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:36.624279 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:36.624279 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:36.624279 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:36.624279 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:36.624279 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:36.624279 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:36.624279 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:36.624279 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:36.624279 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:36.624279 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:36.624279 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:36.626812 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 63/121] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:36.627917 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170ce82-1262-499b-9f47-cbf70fcbdaf9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:36.731705 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16012993-d763-48a9-9d90-635cf9950b86 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:36.747221 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170ce82-1262-499b-9f47-cbf70fcbdaf9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:36.768483 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abc29a-72dc-41ab-93f9-ac19fb1a6e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:36.769362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abc29a-72dc-41ab-93f9-ac19fb1a6e81 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.769649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abc29a-72dc-41ab-93f9-ac19fb1a6e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.769977 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abc29a-72dc-41ab-93f9-ac19fb1a6e81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.782099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abc29a-72dc-41ab-93f9-ac19fb1a6e81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:36.786898 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dad17-36e4-4f4e-9c9d-0d75357db7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:36.789063 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dad17-36e4-4f4e-9c9d-0d75357db7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.789572 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dad17-36e4-4f4e-9c9d-0d75357db7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.790061 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dad17-36e4-4f4e-9c9d-0d75357db7e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b1abc29a-72dc-41ab-93f9-ac19fb1a6e81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:36.791362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:36.792252 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:36.793010 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:36.793010 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:36.793010 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:36.793010 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:36.793010 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:36.793010 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:36.793010 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:36.793010 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:36.793010 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:36.793010 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:36.793010 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:50:36.793010 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:36.793010 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 59/122] 10.222.0.43 () {56 vars in 1114 bytes} [Wed May 25 13:50:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:36.793630 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abc29a-72dc-41ab-93f9-ac19fb1a6e81 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:36.806408 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53dad17-36e4-4f4e-9c9d-0d75357db7e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a53dad17-36e4-4f4e-9c9d-0d75357db7e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:36.815120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:36.816033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:36.816837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:36.816837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:36.816837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:36.816837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:36.816837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:36.816837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:36.816837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:36.816837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:36.816837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:36.816837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:36.816837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:36.816837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:36.825293 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 64/123] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:50:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:36.826574 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dad17-36e4-4f4e-9c9d-0d75357db7e2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:36.861702 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:36.882480 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:36.905085 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abc29a-72dc-41ab-93f9-ac19fb1a6e81 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:36.942038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd093e38-a028-482d-aa5e-d9e6bf7be3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:36.943140 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd093e38-a028-482d-aa5e-d9e6bf7be3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.943605 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dad17-36e4-4f4e-9c9d-0d75357db7e2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:36.943883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd093e38-a028-482d-aa5e-d9e6bf7be3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.944349 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd093e38-a028-482d-aa5e-d9e6bf7be3e3 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.945998 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd093e38-a028-482d-aa5e-d9e6bf7be3e3 None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:36.948651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd093e38-a028-482d-aa5e-d9e6bf7be3e3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:36.950814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 60/124] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:36 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:36.951739 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd093e38-a028-482d-aa5e-d9e6bf7be3e3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:36.983491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a568d1-1b06-4f70-bf7a-4ae1a70d1810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:36.984350 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a568d1-1b06-4f70-bf7a-4ae1a70d1810 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.984838 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a568d1-1b06-4f70-bf7a-4ae1a70d1810 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.985232 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a568d1-1b06-4f70-bf7a-4ae1a70d1810 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.986190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a568d1-1b06-4f70-bf7a-4ae1a70d1810 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:36.986605 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a568d1-1b06-4f70-bf7a-4ae1a70d1810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:36.988127 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a568d1-1b06-4f70-bf7a-4ae1a70d1810 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:37.003051 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 65/125] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:37.003051 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a568d1-1b06-4f70-bf7a-4ae1a70d1810 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:37.094417 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd093e38-a028-482d-aa5e-d9e6bf7be3e3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:37.125319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a568d1-1b06-4f70-bf7a-4ae1a70d1810 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:37.125867 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:37.134163 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cadd8-bb03-4bc1-98c0-8c15f7df041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:37.135074 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cadd8-bb03-4bc1-98c0-8c15f7df041f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:37.135475 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cadd8-bb03-4bc1-98c0-8c15f7df041f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:37.136183 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cadd8-bb03-4bc1-98c0-8c15f7df041f None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:37.136821 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cadd8-bb03-4bc1-98c0-8c15f7df041f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:37.137239 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cadd8-bb03-4bc1-98c0-8c15f7df041f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:37.138803 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:37.138979 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cadd8-bb03-4bc1-98c0-8c15f7df041f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:37.149364 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 61/126] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:50:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:37.150302 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cadd8-bb03-4bc1-98c0-8c15f7df041f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:37.166274 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c9669-f661-41f4-9640-19c59f78c948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:37.167363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c9669-f661-41f4-9640-19c59f78c948 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:37.168171 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c9669-f661-41f4-9640-19c59f78c948 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:37.168612 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c9669-f661-41f4-9640-19c59f78c948 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:37.169778 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c9669-f661-41f4-9640-19c59f78c948 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:37.170229 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c9669-f661-41f4-9640-19c59f78c948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:37.172202 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c9669-f661-41f4-9640-19c59f78c948 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:37.185959 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 66/127] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:37.187351 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c9669-f661-41f4-9640-19c59f78c948 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:37.266794 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cadd8-bb03-4bc1-98c0-8c15f7df041f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:37.313132 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3224629-f3b7-4495-a81a-7deb6285de6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:37.313784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3224629-f3b7-4495-a81a-7deb6285de6a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:37.314068 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3224629-f3b7-4495-a81a-7deb6285de6a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:37.314342 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3224629-f3b7-4495-a81a-7deb6285de6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:37.315168 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3224629-f3b7-4495-a81a-7deb6285de6a None admin] RBAC: Adding query filter params (role.id=36d58da2a9494447b686349f4426d7d7, scope.project.id=66a86bd19c83439885fcd12d7fb788d3, user.id=0b14190ea479428f9261f7330cd53b7f) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:37.315477 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3224629-f3b7-4495-a81a-7deb6285de6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:37.316520 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c9669-f661-41f4-9640-19c59f78c948 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:37.316990 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3224629-f3b7-4495-a81a-7deb6285de6a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:37.323356 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 62/128] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:37 2022] GET /identity/v3/role_assignments?user.id=0b14190ea479428f9261f7330cd53b7f&scope.project.id=66a86bd19c83439885fcd12d7fb788d3&role.id=36d58da2a9494447b686349f4426d7d7 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:37.324020 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3224629-f3b7-4495-a81a-7deb6285de6a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:37.378513 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d8add-308f-4bc7-b93c-1c0ba4645b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:37.381815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d8add-308f-4bc7-b93c-1c0ba4645b34 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:37.382087 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d8add-308f-4bc7-b93c-1c0ba4645b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:37.382476 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d8add-308f-4bc7-b93c-1c0ba4645b34 None admin] PATH_INFO: `/v3/users/f9ffced892d5405fac25fca222a9eb25` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:37.384742 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d8add-308f-4bc7-b93c-1c0ba4645b34 None admin] RBAC: Authorizing `identity:get_user(user_id=f9ffced892d5405fac25fca222a9eb25)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:37.388025 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d8add-308f-4bc7-b93c-1c0ba4645b34 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:37.390598 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 67/129] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:37 2022] GET /identity/v3/users/f9ffced892d5405fac25fca222a9eb25 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:37.392242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d8add-308f-4bc7-b93c-1c0ba4645b34 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:37.440115 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:37.480337 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:37.513443 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3224629-f3b7-4495-a81a-7deb6285de6a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:37.571691 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accc374-5e2c-44b9-9d86-0f2b9fe2e184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:37.572621 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc374-5e2c-44b9-9d86-0f2b9fe2e184 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:37.572975 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc374-5e2c-44b9-9d86-0f2b9fe2e184 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:37.573264 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc374-5e2c-44b9-9d86-0f2b9fe2e184 None admin] PATH_INFO: `/v3/users/f9ffced892d5405fac25fca222a9eb25` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:37.574477 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accc374-5e2c-44b9-9d86-0f2b9fe2e184 None admin] RBAC: Authorizing `identity:get_user(user_id=f9ffced892d5405fac25fca222a9eb25)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:37.575983 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accc374-5e2c-44b9-9d86-0f2b9fe2e184 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:37.577900 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 63/130] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:37 2022] GET /identity/v3/users/f9ffced892d5405fac25fca222a9eb25 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:37.578502 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accc374-5e2c-44b9-9d86-0f2b9fe2e184 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:37.597896 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d8add-308f-4bc7-b93c-1c0ba4645b34 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:37.664160 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc371b2d-853b-4644-b41e-c262458b0f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:37.664964 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc371b2d-853b-4644-b41e-c262458b0f63 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:37.665253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc371b2d-853b-4644-b41e-c262458b0f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:37.665533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc371b2d-853b-4644-b41e-c262458b0f63 None admin] PATH_INFO: `/v3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:37.666944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc371b2d-853b-4644-b41e-c262458b0f63 None admin] RBAC: Authorizing `identity:get_user(user_id=10eec1f5d0fc4da09d1b4c7f6fd362eb)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:37.668441 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc371b2d-853b-4644-b41e-c262458b0f63 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:37.671444 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 68/131] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:37 2022] GET /identity/v3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb => generated 247 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:37.674571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc371b2d-853b-4644-b41e-c262458b0f63 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:37.754455 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accc374-5e2c-44b9-9d86-0f2b9fe2e184 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:37.780461 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:37.792144 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de874c3e-5655-4b7e-9aad-70b2d7a897a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:37.796676 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de874c3e-5655-4b7e-9aad-70b2d7a897a1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:37.796676 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de874c3e-5655-4b7e-9aad-70b2d7a897a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:37.796676 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de874c3e-5655-4b7e-9aad-70b2d7a897a1 None admin] PATH_INFO: `/v3/projects/8f9fd18fa95f432aa5746937ce1a4a5c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:37.796676 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de874c3e-5655-4b7e-9aad-70b2d7a897a1 None admin] RBAC: Authorizing `identity:get_project(project_id=8f9fd18fa95f432aa5746937ce1a4a5c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:37.797394 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de874c3e-5655-4b7e-9aad-70b2d7a897a1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:37.799298 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 64/132] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:37 2022] GET /identity/v3/projects/8f9fd18fa95f432aa5746937ce1a4a5c => generated 312 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:37.800363 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de874c3e-5655-4b7e-9aad-70b2d7a897a1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:37.826635 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc371b2d-853b-4644-b41e-c262458b0f63 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:37.837006 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:37.901428 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d9fdc-03e9-471b-a91c-79ead8730216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:37.902305 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d9fdc-03e9-471b-a91c-79ead8730216 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:37.902570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d9fdc-03e9-471b-a91c-79ead8730216 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:37.902845 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d9fdc-03e9-471b-a91c-79ead8730216 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:37.908474 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d9fdc-03e9-471b-a91c-79ead8730216 None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:37.909946 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d9fdc-03e9-471b-a91c-79ead8730216 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:37.911770 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 69/133] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:37 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:37.912641 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d9fdc-03e9-471b-a91c-79ead8730216 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:37.917385 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de874c3e-5655-4b7e-9aad-70b2d7a897a1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:37.954323 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a213471-f7fd-43c3-a4a0-2c03b439ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:37.955580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a213471-f7fd-43c3-a4a0-2c03b439ce2b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:37.956369 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a213471-f7fd-43c3-a4a0-2c03b439ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:37.956967 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a213471-f7fd-43c3-a4a0-2c03b439ce2b None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:37.958493 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a213471-f7fd-43c3-a4a0-2c03b439ce2b None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:37.960331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a213471-f7fd-43c3-a4a0-2c03b439ce2b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:37.962664 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 65/134] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:37 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:37.963675 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a213471-f7fd-43c3-a4a0-2c03b439ce2b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:38.036205 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:38.079326 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a213471-f7fd-43c3-a4a0-2c03b439ce2b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:38.096371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d9fdc-03e9-471b-a91c-79ead8730216 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:38.114739 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3fd35-2f10-4dd8-a0f2-73ca240b8e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:38.116740 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3fd35-2f10-4dd8-a0f2-73ca240b8e23 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:38.117219 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3fd35-2f10-4dd8-a0f2-73ca240b8e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:38.117792 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3fd35-2f10-4dd8-a0f2-73ca240b8e23 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3/users/f9ffced892d5405fac25fca222a9eb25/roles/9ba48b8364e040eb829f7c1e7662f8d3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:38.120399 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3fd35-2f10-4dd8-a0f2-73ca240b8e23 None admin] RBAC: Authorizing `identity:create_grant(project_id=66a86bd19c83439885fcd12d7fb788d3, user_id=f9ffced892d5405fac25fca222a9eb25, role_id=9ba48b8364e040eb829f7c1e7662f8d3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:38.122135 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3fd35-2f10-4dd8-a0f2-73ca240b8e23 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:38.151624 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182a4f6-fc20-46c6-b21f-7264d0b7dff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:38.152905 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182a4f6-fc20-46c6-b21f-7264d0b7dff2 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:38.153416 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182a4f6-fc20-46c6-b21f-7264d0b7dff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:38.153904 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182a4f6-fc20-46c6-b21f-7264d0b7dff2 None admin] PATH_INFO: `/v3/projects/8f9fd18fa95f432aa5746937ce1a4a5c/users/f9ffced892d5405fac25fca222a9eb25/roles/997ba13b80634887b0a7e88cbf2b2e62` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:38.156164 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182a4f6-fc20-46c6-b21f-7264d0b7dff2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f9fd18fa95f432aa5746937ce1a4a5c, user_id=f9ffced892d5405fac25fca222a9eb25, role_id=997ba13b80634887b0a7e88cbf2b2e62)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:38.157968 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182a4f6-fc20-46c6-b21f-7264d0b7dff2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:38.187258 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 66/135] 10.222.0.43 () {58 vars in 1439 bytes} [Wed May 25 13:50:37 2022] PUT /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3/users/f9ffced892d5405fac25fca222a9eb25/roles/9ba48b8364e040eb829f7c1e7662f8d3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:38.188454 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3fd35-2f10-4dd8-a0f2-73ca240b8e23 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:38.232307 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 70/136] 10.222.0.43 () {58 vars in 1439 bytes} [Wed May 25 13:50:37 2022] PUT /identity/v3/projects/8f9fd18fa95f432aa5746937ce1a4a5c/users/f9ffced892d5405fac25fca222a9eb25/roles/997ba13b80634887b0a7e88cbf2b2e62 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:38.345330 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3fd35-2f10-4dd8-a0f2-73ca240b8e23 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:38.373906 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:38.391645 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dabad8-f843-4b41-acd3-25537a89970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:38.392603 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dabad8-f843-4b41-acd3-25537a89970e None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:38.392885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dabad8-f843-4b41-acd3-25537a89970e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:38.393160 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dabad8-f843-4b41-acd3-25537a89970e None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb/roles/cc4e2e441e3a4f67a7b4ed50677ecaa5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:38.395154 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dabad8-f843-4b41-acd3-25537a89970e None admin] RBAC: Authorizing `identity:create_grant(project_id=66a86bd19c83439885fcd12d7fb788d3, user_id=10eec1f5d0fc4da09d1b4c7f6fd362eb, role_id=cc4e2e441e3a4f67a7b4ed50677ecaa5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:38.397216 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dabad8-f843-4b41-acd3-25537a89970e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:38.494606 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 67/137] 10.222.0.43 () {58 vars in 1439 bytes} [Wed May 25 13:50:38 2022] PUT /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb/roles/cc4e2e441e3a4f67a7b4ed50677ecaa5 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:38.519410 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54269a-c71d-4aa2-9199-b5e3d1615f58 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:38.521277 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54269a-c71d-4aa2-9199-b5e3d1615f58 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:38.521277 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54269a-c71d-4aa2-9199-b5e3d1615f58 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:38.521616 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 71/138] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:38.528319 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6cd2f-2fde-4df3-8e6c-6454da160b93 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:38.528822 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6cd2f-2fde-4df3-8e6c-6454da160b93 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:38.528924 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6cd2f-2fde-4df3-8e6c-6454da160b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:38.554284 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-dde6cd2f-2fde-4df3-8e6c-6454da160b93 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:38.556119 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dde6cd2f-2fde-4df3-8e6c-6454da160b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:38.657157 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 68/139] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:38.682873 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54269a-c71d-4aa2-9199-b5e3d1615f58 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:38.738265 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:38.827435 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54269a-c71d-4aa2-9199-b5e3d1615f58 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:38.869231 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435cebc-aee0-4a7f-9bb9-c461dff22ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:38.870032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435cebc-aee0-4a7f-9bb9-c461dff22ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:38.870365 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435cebc-aee0-4a7f-9bb9-c461dff22ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:38.870645 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435cebc-aee0-4a7f-9bb9-c461dff22ee3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:38.885130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435cebc-aee0-4a7f-9bb9-c461dff22ee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7435cebc-aee0-4a7f-9bb9-c461dff22ee3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:38.892894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:38.893738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:38.894491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:38.894491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:38.894491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:38.894491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:38.894491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:38.894491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:38.894491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:38.894491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:38.894491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:38.894491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:38.894491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:38.894491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:38.894491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 72/140] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:38.901518 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6cd2f-2fde-4df3-8e6c-6454da160b93 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:39.024381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6cd2f-2fde-4df3-8e6c-6454da160b93 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:39.041077 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:39.049021 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fdfac-feaf-423b-aea3-822234282b68 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:39.049316 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fdfac-feaf-423b-aea3-822234282b68 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:39.049600 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fdfac-feaf-423b-aea3-822234282b68 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:39.051156 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 73/141] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:39.056994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dbf9d-77f0-4095-8d85-3b0af9450875 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:39.058601 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dbf9d-77f0-4095-8d85-3b0af9450875 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:39.058601 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dbf9d-77f0-4095-8d85-3b0af9450875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:39.073608 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459707f-8bcb-48c7-90da-6d2c350974fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:39.074288 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459707f-8bcb-48c7-90da-6d2c350974fb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:39.074571 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459707f-8bcb-48c7-90da-6d2c350974fb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:39.074846 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459707f-8bcb-48c7-90da-6d2c350974fb None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:39.076073 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459707f-8bcb-48c7-90da-6d2c350974fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:39.076378 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459707f-8bcb-48c7-90da-6d2c350974fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:39.077960 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459707f-8bcb-48c7-90da-6d2c350974fb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:39.089040 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 69/142] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:39.092816 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d30dbf9d-77f0-4095-8d85-3b0af9450875 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:39.094108 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d30dbf9d-77f0-4095-8d85-3b0af9450875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:39.094733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459707f-8bcb-48c7-90da-6d2c350974fb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:39.228629 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459707f-8bcb-48c7-90da-6d2c350974fb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:39.278372 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 74/143] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:39.289600 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34100b-7afe-4185-86c0-9e545749b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:39.290811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34100b-7afe-4185-86c0-9e545749b99d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:39.291315 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34100b-7afe-4185-86c0-9e545749b99d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:39.291836 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34100b-7afe-4185-86c0-9e545749b99d None admin] PATH_INFO: `/v3/users/f9ffced892d5405fac25fca222a9eb25` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:39.295441 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34100b-7afe-4185-86c0-9e545749b99d None admin] RBAC: Authorizing `identity:get_user(user_id=f9ffced892d5405fac25fca222a9eb25)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:39.298994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34100b-7afe-4185-86c0-9e545749b99d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:39.298994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 70/144] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:39 2022] GET /identity/v3/users/f9ffced892d5405fac25fca222a9eb25 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:39.308863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dbf9d-77f0-4095-8d85-3b0af9450875 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:39.335233 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34100b-7afe-4185-86c0-9e545749b99d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:39.355679 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:39.409283 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:39.506205 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34100b-7afe-4185-86c0-9e545749b99d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:39.561866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dbf9d-77f0-4095-8d85-3b0af9450875 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:39.562073 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05292e16-feb8-4c0f-89e9-25a55d694f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:39.562838 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05292e16-feb8-4c0f-89e9-25a55d694f05 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:39.563125 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05292e16-feb8-4c0f-89e9-25a55d694f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:39.563572 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05292e16-feb8-4c0f-89e9-25a55d694f05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:39.569059 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05292e16-feb8-4c0f-89e9-25a55d694f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:39.571503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05292e16-feb8-4c0f-89e9-25a55d694f05 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:39.573236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 71/145] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:39.579083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05292e16-feb8-4c0f-89e9-25a55d694f05 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:39.653045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac31ea-8a70-4f0d-b2ff-d5f360e6a262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:39.653624 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac31ea-8a70-4f0d-b2ff-d5f360e6a262 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:39.653912 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac31ea-8a70-4f0d-b2ff-d5f360e6a262 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:39.654203 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac31ea-8a70-4f0d-b2ff-d5f360e6a262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:39.767001 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac31ea-8a70-4f0d-b2ff-d5f360e6a262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:39.769198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac31ea-8a70-4f0d-b2ff-d5f360e6a262 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:39.789823 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05292e16-feb8-4c0f-89e9-25a55d694f05 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:39.796017 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:39.811307 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:39.876985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 75/146] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:50:39.883237 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac31ea-8a70-4f0d-b2ff-d5f360e6a262 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:39.894767 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b5fb7-9b25-418b-a094-a9c8086b52c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:39.895694 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b5fb7-9b25-418b-a094-a9c8086b52c3 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:39.896270 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b5fb7-9b25-418b-a094-a9c8086b52c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:39.897068 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b5fb7-9b25-418b-a094-a9c8086b52c3 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:39.898048 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b5fb7-9b25-418b-a094-a9c8086b52c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:39.899701 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b5fb7-9b25-418b-a094-a9c8086b52c3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:40.008986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac31ea-8a70-4f0d-b2ff-d5f360e6a262 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:40.019495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 72/147] 10.222.0.43 () {60 vars in 1132 bytes} [Wed May 25 13:50:39 2022] POST /identity/v3/users => generated 283 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:50:40.058899 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:40.071968 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ba294-d54b-48da-8d2f-6610a67f8cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:40.073173 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ba294-d54b-48da-8d2f-6610a67f8cde None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:40.073635 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ba294-d54b-48da-8d2f-6610a67f8cde None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:40.074086 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ba294-d54b-48da-8d2f-6610a67f8cde None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:40.080753 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ba294-d54b-48da-8d2f-6610a67f8cde None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:40.082672 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ba294-d54b-48da-8d2f-6610a67f8cde None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:40.084778 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 76/148] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:39 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:40.091216 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b5fb7-9b25-418b-a094-a9c8086b52c3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:40.229716 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b5fb7-9b25-418b-a094-a9c8086b52c3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:40.270198 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1665cf0-0324-4d65-bf85-a1b0caf9eb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:40.271210 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665cf0-0324-4d65-bf85-a1b0caf9eb1c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:40.272362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665cf0-0324-4d65-bf85-a1b0caf9eb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:40.272824 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665cf0-0324-4d65-bf85-a1b0caf9eb1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:40.273850 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1665cf0-0324-4d65-bf85-a1b0caf9eb1c None admin] RBAC: Adding query filter params (role.id=997ba13b80634887b0a7e88cbf2b2e62, scope.project.id=66a86bd19c83439885fcd12d7fb788d3, user.id=f9ffced892d5405fac25fca222a9eb25) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:40.274371 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1665cf0-0324-4d65-bf85-a1b0caf9eb1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:40.276071 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1665cf0-0324-4d65-bf85-a1b0caf9eb1c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:40.287147 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 73/149] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:40 2022] GET /identity/v3/role_assignments?user.id=f9ffced892d5405fac25fca222a9eb25&scope.project.id=66a86bd19c83439885fcd12d7fb788d3&role.id=997ba13b80634887b0a7e88cbf2b2e62 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:40.336946 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a9b4c-688b-40a0-ac84-256719b4509e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:40.337552 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a9b4c-688b-40a0-ac84-256719b4509e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:40.338003 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a9b4c-688b-40a0-ac84-256719b4509e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:40.339570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 77/150] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:40.346526 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd7906-eac6-4ca9-8b6c-140b0d3949ee None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:40.347077 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd7906-eac6-4ca9-8b6c-140b0d3949ee None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:40.347559 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd7906-eac6-4ca9-8b6c-140b0d3949ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:40.372203 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-00bd7906-eac6-4ca9-8b6c-140b0d3949ee None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:40.373766 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-00bd7906-eac6-4ca9-8b6c-140b0d3949ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:40.411428 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:40.475534 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 74/151] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:40.498361 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a9b4c-688b-40a0-ac84-256719b4509e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:40.624438 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a9b4c-688b-40a0-ac84-256719b4509e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:40.666617 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76c561-0cba-4b07-aa5c-d27696d21b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:40.667423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76c561-0cba-4b07-aa5c-d27696d21b0b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:40.667706 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76c561-0cba-4b07-aa5c-d27696d21b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:40.667995 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76c561-0cba-4b07-aa5c-d27696d21b0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:40.681869 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76c561-0cba-4b07-aa5c-d27696d21b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1d76c561-0cba-4b07-aa5c-d27696d21b0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:40.689723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:40.690571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:40.691517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:40.691517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:40.691517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:40.691517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:40.691517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:40.691517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:40.691517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:40.691517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:40.691517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:40.691517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:40.691517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:50:40.691517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:40.691517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 78/152] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:40.701080 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd7906-eac6-4ca9-8b6c-140b0d3949ee None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:40.819194 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd7906-eac6-4ca9-8b6c-140b0d3949ee None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:40.854902 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e78a4-40b4-4643-922f-4a1b080ebad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:40.855614 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e78a4-40b4-4643-922f-4a1b080ebad2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:40.855915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e78a4-40b4-4643-922f-4a1b080ebad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:40.856197 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e78a4-40b4-4643-922f-4a1b080ebad2 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:40.856949 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e78a4-40b4-4643-922f-4a1b080ebad2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:40.857258 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e78a4-40b4-4643-922f-4a1b080ebad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:40.858777 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e78a4-40b4-4643-922f-4a1b080ebad2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:40.867627 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 75/153] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:40.873607 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76c561-0cba-4b07-aa5c-d27696d21b0b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:40.937096 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:40.993216 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76c561-0cba-4b07-aa5c-d27696d21b0b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:41.035436 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba4399-3c47-45ec-b8ca-233fadf12734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:41.036343 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba4399-3c47-45ec-b8ca-233fadf12734 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:41.036625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba4399-3c47-45ec-b8ca-233fadf12734 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:41.036900 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba4399-3c47-45ec-b8ca-233fadf12734 None admin] PATH_INFO: `/v3/users/0b14190ea479428f9261f7330cd53b7f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:41.038680 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba4399-3c47-45ec-b8ca-233fadf12734 None admin] RBAC: Authorizing `identity:get_user(user_id=0b14190ea479428f9261f7330cd53b7f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:41.040179 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba4399-3c47-45ec-b8ca-233fadf12734 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:41.041831 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 79/154] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:40 2022] GET /identity/v3/users/0b14190ea479428f9261f7330cd53b7f => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:41.048069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e78a4-40b4-4643-922f-4a1b080ebad2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:41.081939 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:41.176339 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e78a4-40b4-4643-922f-4a1b080ebad2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:41.229208 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ea965-2bcc-4dfe-adf4-90f1610b61a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:41.230401 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ea965-2bcc-4dfe-adf4-90f1610b61a4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:41.230886 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ea965-2bcc-4dfe-adf4-90f1610b61a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:41.231356 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ea965-2bcc-4dfe-adf4-90f1610b61a4 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:41.236660 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ea965-2bcc-4dfe-adf4-90f1610b61a4 None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:41.238580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ea965-2bcc-4dfe-adf4-90f1610b61a4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:41.241195 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 76/155] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:41 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:41.247355 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba4399-3c47-45ec-b8ca-233fadf12734 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:41.380400 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba4399-3c47-45ec-b8ca-233fadf12734 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:41.402157 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:41.422373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545def93-3ade-44b4-b7fe-a1266260b581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:41.431336 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545def93-3ade-44b4-b7fe-a1266260b581 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:41.431336 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545def93-3ade-44b4-b7fe-a1266260b581 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:41.431336 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545def93-3ade-44b4-b7fe-a1266260b581 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3/users/0b14190ea479428f9261f7330cd53b7f/roles/36d58da2a9494447b686349f4426d7d7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:41.431336 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545def93-3ade-44b4-b7fe-a1266260b581 None admin] RBAC: Authorizing `identity:create_grant(project_id=66a86bd19c83439885fcd12d7fb788d3, user_id=0b14190ea479428f9261f7330cd53b7f, role_id=36d58da2a9494447b686349f4426d7d7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:41.431336 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545def93-3ade-44b4-b7fe-a1266260b581 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:41.482975 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ca6e5-4f85-4a97-b53d-a8c14050ac6c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:41.483256 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ca6e5-4f85-4a97-b53d-a8c14050ac6c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:41.483462 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ca6e5-4f85-4a97-b53d-a8c14050ac6c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:41.485169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 77/156] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:41.491318 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888278ef-6900-4c40-932a-921ad9a169d8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:41.491628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888278ef-6900-4c40-932a-921ad9a169d8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:41.491913 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888278ef-6900-4c40-932a-921ad9a169d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:41.518525 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-888278ef-6900-4c40-932a-921ad9a169d8 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:41.519703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-888278ef-6900-4c40-932a-921ad9a169d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:41.524816 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 80/157] 10.222.0.43 () {58 vars in 1439 bytes} [Wed May 25 13:50:41 2022] PUT /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3/users/0b14190ea479428f9261f7330cd53b7f/roles/36d58da2a9494447b686349f4426d7d7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:41.616447 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 78/158] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:50:41.666721 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545def93-3ade-44b4-b7fe-a1266260b581 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:41.813500 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545def93-3ade-44b4-b7fe-a1266260b581 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:41.852717 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037f7b4-985f-48ad-88b4-5859290daa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:41.853532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f7b4-985f-48ad-88b4-5859290daa87 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:41.853817 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f7b4-985f-48ad-88b4-5859290daa87 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:41.854091 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f7b4-985f-48ad-88b4-5859290daa87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:41.869788 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037f7b4-985f-48ad-88b4-5859290daa87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f037f7b4-985f-48ad-88b4-5859290daa87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:41.877693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:41.878972 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:41.880242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:41.880242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:41.880242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:41.880242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:41.880242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:41.880242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:41.880242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:41.880242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:41.880242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:41.880242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:41.880242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:41.880242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:41.880242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 81/159] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:41.887373 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888278ef-6900-4c40-932a-921ad9a169d8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:41.909999 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:42.011964 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888278ef-6900-4c40-932a-921ad9a169d8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:42.063755 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68b62a-ccc0-46f7-8ac5-2be21679f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:42.064352 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68b62a-ccc0-46f7-8ac5-2be21679f295 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:42.064641 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68b62a-ccc0-46f7-8ac5-2be21679f295 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:42.064920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68b62a-ccc0-46f7-8ac5-2be21679f295 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:42.065677 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68b62a-ccc0-46f7-8ac5-2be21679f295 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:42.065984 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68b62a-ccc0-46f7-8ac5-2be21679f295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:42.067387 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68b62a-ccc0-46f7-8ac5-2be21679f295 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:42.079308 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 79/160] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:42.085616 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037f7b4-985f-48ad-88b4-5859290daa87 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:42.117672 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b93a84-d43b-4ea2-9b44-1cf0b93ae55c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:42.117967 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b93a84-d43b-4ea2-9b44-1cf0b93ae55c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:42.118243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b93a84-d43b-4ea2-9b44-1cf0b93ae55c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:42.119915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 80/161] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:42.133897 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd1630-01fe-492c-8d32-053a846f7467 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:42.134176 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd1630-01fe-492c-8d32-053a846f7467 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:42.134459 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd1630-01fe-492c-8d32-053a846f7467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:42.160142 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:42.169133 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-37fd1630-01fe-492c-8d32-053a846f7467 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:42.170345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-37fd1630-01fe-492c-8d32-053a846f7467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:42.305077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037f7b4-985f-48ad-88b4-5859290daa87 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:42.364289 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d151870-dff5-499b-8d82-719422faa2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:42.365497 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 81/162] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 25 13:50:42.366120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d151870-dff5-499b-8d82-719422faa2bf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:42.366658 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d151870-dff5-499b-8d82-719422faa2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:42.366931 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d1057-701f-4334-8e5a-fdc91be411f0 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:42.367232 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d1057-701f-4334-8e5a-fdc91be411f0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:42.367470 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d151870-dff5-499b-8d82-719422faa2bf None admin] PATH_INFO: `/v3/users/f9ffced892d5405fac25fca222a9eb25` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:42.367572 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d1057-701f-4334-8e5a-fdc91be411f0 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:42.368811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 82/163] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:42.369204 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d151870-dff5-499b-8d82-719422faa2bf None admin] RBAC: Authorizing `identity:get_user(user_id=f9ffced892d5405fac25fca222a9eb25)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:42.375739 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d151870-dff5-499b-8d82-719422faa2bf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:42.376046 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ea45f-52a7-45e8-8a9f-0c8f800145c8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:42.376343 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ea45f-52a7-45e8-8a9f-0c8f800145c8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:42.376629 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ea45f-52a7-45e8-8a9f-0c8f800145c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:42.378388 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 82/164] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:42 2022] GET /identity/v3/users/f9ffced892d5405fac25fca222a9eb25 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:42.384573 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d151870-dff5-499b-8d82-719422faa2bf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:42.408730 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-483ea45f-52a7-45e8-8a9f-0c8f800145c8 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:42.409919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-483ea45f-52a7-45e8-8a9f-0c8f800145c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:42.416064 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:42.541293 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d151870-dff5-499b-8d82-719422faa2bf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:42.560488 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:42.609769 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49a98e-bdc7-4600-acfc-301a27ff2fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:42.610431 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49a98e-bdc7-4600-acfc-301a27ff2fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:42.610720 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49a98e-bdc7-4600-acfc-301a27ff2fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:42.611000 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49a98e-bdc7-4600-acfc-301a27ff2fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:42.613067 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 83/165] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:50:42.614014 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ea45f-52a7-45e8-8a9f-0c8f800145c8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:42.757677 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49a98e-bdc7-4600-acfc-301a27ff2fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:42.759230 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49a98e-bdc7-4600-acfc-301a27ff2fb9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:42.795530 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ea45f-52a7-45e8-8a9f-0c8f800145c8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:42.832527 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea55e-e67a-4981-af36-47d6a33b06e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:42.839738 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea55e-e67a-4981-af36-47d6a33b06e6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:42.840394 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea55e-e67a-4981-af36-47d6a33b06e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:42.840822 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea55e-e67a-4981-af36-47d6a33b06e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:42.854673 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:42.858099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ea55e-e67a-4981-af36-47d6a33b06e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-418ea55e-e67a-4981-af36-47d6a33b06e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:42.867083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:42.872686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:42.873915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:42.873915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:42.873915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:42.873915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:42.873915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:42.873915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:42.873915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:42.873915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:42.873915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:42.873915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:42.873915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:50:42.873915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:42.875666 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 84/166] 10.222.0.43 () {56 vars in 1114 bytes} [Wed May 25 13:50:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:42.876727 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea55e-e67a-4981-af36-47d6a33b06e6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:42.993902 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 83/167] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:50:42.994762 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49a98e-bdc7-4600-acfc-301a27ff2fb9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:43.011661 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:43.062327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea55e-e67a-4981-af36-47d6a33b06e6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:43.133595 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19492b-2bb6-4722-a40d-6fa973f2079b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:43.134750 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19492b-2bb6-4722-a40d-6fa973f2079b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:43.135169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19492b-2bb6-4722-a40d-6fa973f2079b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:43.135588 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19492b-2bb6-4722-a40d-6fa973f2079b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:43.161220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19492b-2bb6-4722-a40d-6fa973f2079b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-0f19492b-2bb6-4722-a40d-6fa973f2079b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:43.170086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:43.170937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:43.171772 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:43.171772 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:43.171772 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:43.171772 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:43.171772 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:43.171772 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:43.171772 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:43.171772 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:43.171772 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:43.171772 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:43.171772 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:43.171772 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:43.171772 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 85/168] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:50:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:43.180819 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19492b-2bb6-4722-a40d-6fa973f2079b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:43.242780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49a98e-bdc7-4600-acfc-301a27ff2fb9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:43.275428 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:43.351164 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19492b-2bb6-4722-a40d-6fa973f2079b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:43.375938 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92567a7-ba8f-47cf-953d-987aa67433e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:43.376726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92567a7-ba8f-47cf-953d-987aa67433e8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:43.381547 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92567a7-ba8f-47cf-953d-987aa67433e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:43.381547 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92567a7-ba8f-47cf-953d-987aa67433e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:43.381547 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92567a7-ba8f-47cf-953d-987aa67433e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:43.381547 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92567a7-ba8f-47cf-953d-987aa67433e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:43.381547 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92567a7-ba8f-47cf-953d-987aa67433e8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:43.403045 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f31467-1be9-4cee-9f0d-d446886d0106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:43.404245 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f31467-1be9-4cee-9f0d-d446886d0106 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:43.404700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f31467-1be9-4cee-9f0d-d446886d0106 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:43.405173 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f31467-1be9-4cee-9f0d-d446886d0106 None admin] PATH_INFO: `/v3/projects/8f9fd18fa95f432aa5746937ce1a4a5c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:43.406521 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 84/169] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:50:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:43.406648 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f31467-1be9-4cee-9f0d-d446886d0106 None admin] RBAC: Authorizing `identity:get_project(project_id=8f9fd18fa95f432aa5746937ce1a4a5c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:43.407447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92567a7-ba8f-47cf-953d-987aa67433e8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:43.413393 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f31467-1be9-4cee-9f0d-d446886d0106 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:43.415675 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 86/170] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:43 2022] GET /identity/v3/projects/8f9fd18fa95f432aa5746937ce1a4a5c => generated 312 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:43.416781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f31467-1be9-4cee-9f0d-d446886d0106 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:43.533183 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f31467-1be9-4cee-9f0d-d446886d0106 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:43.553716 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:43.564863 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:43.571263 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb5378-7a03-4a24-8fb4-dca6c69f7d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:43.572538 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5378-7a03-4a24-8fb4-dca6c69f7d42 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:43.573041 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5378-7a03-4a24-8fb4-dca6c69f7d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:43.573513 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5378-7a03-4a24-8fb4-dca6c69f7d42 None admin] PATH_INFO: `/v3/users/f9ffced892d5405fac25fca222a9eb25` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:43.574914 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb5378-7a03-4a24-8fb4-dca6c69f7d42 None admin] RBAC: Authorizing `identity:get_user(user_id=f9ffced892d5405fac25fca222a9eb25)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:43.576578 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb5378-7a03-4a24-8fb4-dca6c69f7d42 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:43.578539 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 87/171] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:43 2022] GET /identity/v3/users/f9ffced892d5405fac25fca222a9eb25 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:43.579525 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb5378-7a03-4a24-8fb4-dca6c69f7d42 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:43.619653 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92567a7-ba8f-47cf-953d-987aa67433e8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:43.685574 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202024af-5eec-4282-abc2-49bb2295cb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:43.686391 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202024af-5eec-4282-abc2-49bb2295cb00 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:43.686728 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202024af-5eec-4282-abc2-49bb2295cb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:43.687069 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202024af-5eec-4282-abc2-49bb2295cb00 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:43.687919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202024af-5eec-4282-abc2-49bb2295cb00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:43.688390 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202024af-5eec-4282-abc2-49bb2295cb00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:43.689960 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202024af-5eec-4282-abc2-49bb2295cb00 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:43.695855 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb5378-7a03-4a24-8fb4-dca6c69f7d42 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:43.707384 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 85/172] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:43.711740 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202024af-5eec-4282-abc2-49bb2295cb00 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:43.737850 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303c0ce-8d02-4523-b0e1-e9699684bc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:43.738823 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303c0ce-8d02-4523-b0e1-e9699684bc33 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:43.739278 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303c0ce-8d02-4523-b0e1-e9699684bc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:43.739798 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303c0ce-8d02-4523-b0e1-e9699684bc33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:43.741445 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303c0ce-8d02-4523-b0e1-e9699684bc33 None admin] RBAC: Adding query filter params (role.id=997ba13b80634887b0a7e88cbf2b2e62, scope.project.id=8f9fd18fa95f432aa5746937ce1a4a5c, user.id=f9ffced892d5405fac25fca222a9eb25) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:43.742067 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303c0ce-8d02-4523-b0e1-e9699684bc33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:43.743767 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303c0ce-8d02-4523-b0e1-e9699684bc33 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:43.750356 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 88/173] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:43 2022] GET /identity/v3/role_assignments?user.id=f9ffced892d5405fac25fca222a9eb25&scope.project.id=8f9fd18fa95f432aa5746937ce1a4a5c&role.id=997ba13b80634887b0a7e88cbf2b2e62 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:43.751417 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303c0ce-8d02-4523-b0e1-e9699684bc33 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:43.817177 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:43.868139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303c0ce-8d02-4523-b0e1-e9699684bc33 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:43.911434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202024af-5eec-4282-abc2-49bb2295cb00 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:43.949964 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c60345-6ffc-4239-83db-0dd5281e4d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:43.950865 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c60345-6ffc-4239-83db-0dd5281e4d51 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:43.951192 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c60345-6ffc-4239-83db-0dd5281e4d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:43.951479 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c60345-6ffc-4239-83db-0dd5281e4d51 None admin] PATH_INFO: `/v3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:43.952895 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c60345-6ffc-4239-83db-0dd5281e4d51 None admin] RBAC: Authorizing `identity:get_user(user_id=10eec1f5d0fc4da09d1b4c7f6fd362eb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:43.961201 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c60345-6ffc-4239-83db-0dd5281e4d51 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:43.963209 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 89/174] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:43 2022] GET /identity/v3/users/10eec1f5d0fc4da09d1b4c7f6fd362eb => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:43.969274 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c60345-6ffc-4239-83db-0dd5281e4d51 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:43.974273 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:43.987104 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c692a7-f852-4a4f-aa40-9b5ad6b8809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:43.988252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c692a7-f852-4a4f-aa40-9b5ad6b8809a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:43.988252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c692a7-f852-4a4f-aa40-9b5ad6b8809a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:43.988421 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c692a7-f852-4a4f-aa40-9b5ad6b8809a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:44.098064 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c692a7-f852-4a4f-aa40-9b5ad6b8809a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:44.100173 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c692a7-f852-4a4f-aa40-9b5ad6b8809a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:44.173695 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c60345-6ffc-4239-83db-0dd5281e4d51 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:44.232083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5e04a-e3c1-420f-9929-0b80ca0c64fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:44.233131 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5e04a-e3c1-420f-9929-0b80ca0c64fe None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:44.233621 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5e04a-e3c1-420f-9929-0b80ca0c64fe None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:44.234093 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5e04a-e3c1-420f-9929-0b80ca0c64fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:44.240206 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:44.356005 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5e04a-e3c1-420f-9929-0b80ca0c64fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:44.356005 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5e04a-e3c1-420f-9929-0b80ca0c64fe None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:44.418441 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 86/175] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:50:44.428845 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c692a7-f852-4a4f-aa40-9b5ad6b8809a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:44.500124 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 90/176] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:50:44.501559 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286f2e7-26b4-4379-96be-1b6abd084dba None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:44.501848 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286f2e7-26b4-4379-96be-1b6abd084dba None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:44.502132 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286f2e7-26b4-4379-96be-1b6abd084dba None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:44.503568 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 91/177] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:44.505263 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286f2e7-26b4-4379-96be-1b6abd084dba None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:44.517406 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:44.572128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:44.621114 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286f2e7-26b4-4379-96be-1b6abd084dba None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:44.640409 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c692a7-f852-4a4f-aa40-9b5ad6b8809a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:44.658888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52b9f0-1754-45cf-bf6e-c5d1490315ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:44.660065 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52b9f0-1754-45cf-bf6e-c5d1490315ea None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:44.660548 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52b9f0-1754-45cf-bf6e-c5d1490315ea None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:44.660996 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52b9f0-1754-45cf-bf6e-c5d1490315ea None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:44.662488 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52b9f0-1754-45cf-bf6e-c5d1490315ea None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:44.664158 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52b9f0-1754-45cf-bf6e-c5d1490315ea None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:44.666304 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 92/178] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:44 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:44.667685 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77a30a-ad31-4962-969f-6a4c1963d318 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:44.672569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77a30a-ad31-4962-969f-6a4c1963d318 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:44.672569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77a30a-ad31-4962-969f-6a4c1963d318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:44.683850 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29cf94-56ec-45b6-99dd-54823e902f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:44.685456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29cf94-56ec-45b6-99dd-54823e902f78 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:44.685961 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29cf94-56ec-45b6-99dd-54823e902f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:44.686708 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29cf94-56ec-45b6-99dd-54823e902f78 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:44.688156 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29cf94-56ec-45b6-99dd-54823e902f78 None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:44.689938 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29cf94-56ec-45b6-99dd-54823e902f78 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:44.690313 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9b77a30a-ad31-4962-969f-6a4c1963d318 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:44.691499 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9b77a30a-ad31-4962-969f-6a4c1963d318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:44.692301 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 87/179] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:44 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:44.694271 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63cf00-ab3a-4b0b-9542-09e15c873855 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:44.694774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63cf00-ab3a-4b0b-9542-09e15c873855 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:44.696077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63cf00-ab3a-4b0b-9542-09e15c873855 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:44.697663 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 88/180] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:44.698563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63cf00-ab3a-4b0b-9542-09e15c873855 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:44.785314 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 93/181] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:44.786154 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77a30a-ad31-4962-969f-6a4c1963d318 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:44.837069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:44.838837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:44.843759 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63cf00-ab3a-4b0b-9542-09e15c873855 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:44.890408 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ab196-7b53-454f-8305-07db0535cf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:44.890993 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ab196-7b53-454f-8305-07db0535cf7a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:44.891282 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ab196-7b53-454f-8305-07db0535cf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:44.891565 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ab196-7b53-454f-8305-07db0535cf7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:44.892774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ab196-7b53-454f-8305-07db0535cf7a None admin] RBAC: Adding query filter params (role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5, scope.project.id=66a86bd19c83439885fcd12d7fb788d3, user.id=10eec1f5d0fc4da09d1b4c7f6fd362eb) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:44.893338 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ab196-7b53-454f-8305-07db0535cf7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:44.895969 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ab196-7b53-454f-8305-07db0535cf7a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:44.905386 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 89/182] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:44 2022] GET /identity/v3/role_assignments?user.id=10eec1f5d0fc4da09d1b4c7f6fd362eb&scope.project.id=66a86bd19c83439885fcd12d7fb788d3&role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:44.907117 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a2177-d13b-45c8-a6ea-b5786d49b81d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:44.907608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a2177-d13b-45c8-a6ea-b5786d49b81d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:44.908111 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a2177-d13b-45c8-a6ea-b5786d49b81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:44.933409 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-397a2177-d13b-45c8-a6ea-b5786d49b81d None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:44.934971 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-397a2177-d13b-45c8-a6ea-b5786d49b81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:44.964251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77a30a-ad31-4962-969f-6a4c1963d318 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.005686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bbf69-fd45-44c3-8940-8a87de43071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.006811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bbf69-fd45-44c3-8940-8a87de43071b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.007309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bbf69-fd45-44c3-8940-8a87de43071b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.007845 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bbf69-fd45-44c3-8940-8a87de43071b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.008954 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bbf69-fd45-44c3-8940-8a87de43071b None admin] RBAC: Adding query filter params (role.id=9ba48b8364e040eb829f7c1e7662f8d3, scope.project.id=66a86bd19c83439885fcd12d7fb788d3, user.id=f9ffced892d5405fac25fca222a9eb25) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:45.009480 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bbf69-fd45-44c3-8940-8a87de43071b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:45.011200 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bbf69-fd45-44c3-8940-8a87de43071b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:45.018146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 94/183] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:44 2022] GET /identity/v3/role_assignments?user.id=f9ffced892d5405fac25fca222a9eb25&scope.project.id=66a86bd19c83439885fcd12d7fb788d3&role.id=9ba48b8364e040eb829f7c1e7662f8d3 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:45.019513 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bbf69-fd45-44c3-8940-8a87de43071b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:45.027852 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 90/184] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:45.027852 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124892fb-7f8f-4c30-bdf6-f6044d5ba1cb None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.027852 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124892fb-7f8f-4c30-bdf6-f6044d5ba1cb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.027852 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124892fb-7f8f-4c30-bdf6-f6044d5ba1cb None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.031947 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 91/185] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:45.033507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299f6b7-6273-49fa-a3f6-18f25e8d71b3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.033801 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299f6b7-6273-49fa-a3f6-18f25e8d71b3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.034087 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299f6b7-6273-49fa-a3f6-18f25e8d71b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.053428 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a299f6b7-6273-49fa-a3f6-18f25e8d71b3 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:45.054643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a299f6b7-6273-49fa-a3f6-18f25e8d71b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:45.141091 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 92/186] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:45.141903 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299f6b7-6273-49fa-a3f6-18f25e8d71b3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:45.161288 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:45.173308 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bbf69-fd45-44c3-8940-8a87de43071b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.198627 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:45.229942 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0365583-f467-47ec-871b-906ed1770655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.231224 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0365583-f467-47ec-871b-906ed1770655 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.231333 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0365583-f467-47ec-871b-906ed1770655 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.232121 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0365583-f467-47ec-871b-906ed1770655 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.249029 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0365583-f467-47ec-871b-906ed1770655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a0365583-f467-47ec-871b-906ed1770655 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:45.257801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:45.258712 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:45.259503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:45.259503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:45.259503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:45.259503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:45.259503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:45.259503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:45.259503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:45.259503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:45.259503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:45.259503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:45.259503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:45.259503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:45.259503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 95/187] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:50:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:45.260676 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fc0e9-8076-437a-8e39-83093bc47d76 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.260782 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fc0e9-8076-437a-8e39-83093bc47d76 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.261017 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fc0e9-8076-437a-8e39-83093bc47d76 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.262490 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 96/188] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:45.265367 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fc0e9-8076-437a-8e39-83093bc47d76 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:45.303438 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299f6b7-6273-49fa-a3f6-18f25e8d71b3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.346626 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efd2e2-2b6d-4a30-a5b0-e22ac1e070c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.347431 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efd2e2-2b6d-4a30-a5b0-e22ac1e070c4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.347734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efd2e2-2b6d-4a30-a5b0-e22ac1e070c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.348025 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efd2e2-2b6d-4a30-a5b0-e22ac1e070c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.359270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efd2e2-2b6d-4a30-a5b0-e22ac1e070c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e5efd2e2-2b6d-4a30-a5b0-e22ac1e070c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:45.368288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:45.369327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:45.370148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:45.370148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:45.370148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:45.370148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:45.370148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:45.370148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:45.370148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:45.370148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:45.370148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:45.370148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:45.370148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:50:45.370148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:45.370148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 93/189] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:45.370799 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efd2e2-2b6d-4a30-a5b0-e22ac1e070c4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:45.385103 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fc0e9-8076-437a-8e39-83093bc47d76 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.419645 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21706a1c-e6c2-44b3-9069-4a7cd0704c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.420414 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21706a1c-e6c2-44b3-9069-4a7cd0704c30 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.420703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21706a1c-e6c2-44b3-9069-4a7cd0704c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.420993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21706a1c-e6c2-44b3-9069-4a7cd0704c30 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.431222 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21706a1c-e6c2-44b3-9069-4a7cd0704c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-21706a1c-e6c2-44b3-9069-4a7cd0704c30 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:45.439286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:45.440243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:45.441253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:45.441253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:45.441253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:45.441253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:45.441253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:45.441253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:45.441253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:45.441253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:45.441253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:45.441253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:45.441253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:50:45.441253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:45.441253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 97/190] 10.222.0.43 () {56 vars in 1114 bytes} [Wed May 25 13:50:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:45.442337 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf3d3a-4b5a-4d86-a58b-e13c62b7950b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.442337 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf3d3a-4b5a-4d86-a58b-e13c62b7950b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.442337 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf3d3a-4b5a-4d86-a58b-e13c62b7950b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.458317 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f6bf3d3a-4b5a-4d86-a58b-e13c62b7950b None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:45.458477 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:45.460150 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f6bf3d3a-4b5a-4d86-a58b-e13c62b7950b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:45.463352 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:45.476726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efd2e2-2b6d-4a30-a5b0-e22ac1e070c4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.512307 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c117b6-c7d8-4ddf-be6b-4b7b323daa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.513108 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c117b6-c7d8-4ddf-be6b-4b7b323daa7f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.513398 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c117b6-c7d8-4ddf-be6b-4b7b323daa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.513680 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c117b6-c7d8-4ddf-be6b-4b7b323daa7f None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.514436 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c117b6-c7d8-4ddf-be6b-4b7b323daa7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:45.514742 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c117b6-c7d8-4ddf-be6b-4b7b323daa7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:45.516249 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c117b6-c7d8-4ddf-be6b-4b7b323daa7f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:45.525368 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 94/191] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:45.525368 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c117b6-c7d8-4ddf-be6b-4b7b323daa7f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:45.530262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 98/192] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:45.530262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf3d3a-4b5a-4d86-a58b-e13c62b7950b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:45.627487 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf3d3a-4b5a-4d86-a58b-e13c62b7950b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.637630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c117b6-c7d8-4ddf-be6b-4b7b323daa7f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.661534 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71cec7-1735-4506-98c1-2c0c947bda67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.662484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71cec7-1735-4506-98c1-2c0c947bda67 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.662769 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71cec7-1735-4506-98c1-2c0c947bda67 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.663046 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71cec7-1735-4506-98c1-2c0c947bda67 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.663824 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71cec7-1735-4506-98c1-2c0c947bda67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:45.664133 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71cec7-1735-4506-98c1-2c0c947bda67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:45.665546 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71cec7-1735-4506-98c1-2c0c947bda67 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:45.670619 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64207545-a58f-4ec5-b2f1-3159d0c16911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.671219 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64207545-a58f-4ec5-b2f1-3159d0c16911 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.671500 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64207545-a58f-4ec5-b2f1-3159d0c16911 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.671800 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64207545-a58f-4ec5-b2f1-3159d0c16911 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.672532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64207545-a58f-4ec5-b2f1-3159d0c16911 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:45.672833 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64207545-a58f-4ec5-b2f1-3159d0c16911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:45.673473 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 99/193] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:50:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:45.674185 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64207545-a58f-4ec5-b2f1-3159d0c16911 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:45.676669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71cec7-1735-4506-98c1-2c0c947bda67 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:45.680058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:45.688405 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 95/194] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:45.688405 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64207545-a58f-4ec5-b2f1-3159d0c16911 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:45.697523 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:45.773713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71cec7-1735-4506-98c1-2c0c947bda67 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.785084 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64207545-a58f-4ec5-b2f1-3159d0c16911 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.806539 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe7f3c-5766-4a92-9ebf-1ae3291cb1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.807413 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe7f3c-5766-4a92-9ebf-1ae3291cb1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.807698 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe7f3c-5766-4a92-9ebf-1ae3291cb1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.808005 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe7f3c-5766-4a92-9ebf-1ae3291cb1d4 None admin] PATH_INFO: `/v3/users/079c41da73c14d9bb1396d93be2b9a06` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.819068 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92205be-505e-4b6b-911e-7a8f5b009554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.819885 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92205be-505e-4b6b-911e-7a8f5b009554 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.820174 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92205be-505e-4b6b-911e-7a8f5b009554 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.820454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92205be-505e-4b6b-911e-7a8f5b009554 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.821476 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe7f3c-5766-4a92-9ebf-1ae3291cb1d4 None admin] RBAC: Authorizing `identity:get_user(user_id=079c41da73c14d9bb1396d93be2b9a06)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:45.821632 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92205be-505e-4b6b-911e-7a8f5b009554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:45.822971 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe7f3c-5766-4a92-9ebf-1ae3291cb1d4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:45.823073 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92205be-505e-4b6b-911e-7a8f5b009554 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:45.824824 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 96/196] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:45.824923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 100/196] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:45 2022] GET /identity/v3/users/079c41da73c14d9bb1396d93be2b9a06 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:45.825565 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92205be-505e-4b6b-911e-7a8f5b009554 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:45.825656 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe7f3c-5766-4a92-9ebf-1ae3291cb1d4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:45.889349 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:45.902126 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:45.924723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92205be-505e-4b6b-911e-7a8f5b009554 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.929079 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe7f3c-5766-4a92-9ebf-1ae3291cb1d4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.959412 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b26cf0-7114-4ad1-9df0-62eafe2fbfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.960306 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b26cf0-7114-4ad1-9df0-62eafe2fbfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.960595 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b26cf0-7114-4ad1-9df0-62eafe2fbfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.960873 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b26cf0-7114-4ad1-9df0-62eafe2fbfc6 None admin] PATH_INFO: `/v3/users/079c41da73c14d9bb1396d93be2b9a06` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.962055 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b26cf0-7114-4ad1-9df0-62eafe2fbfc6 None admin] RBAC: Authorizing `identity:get_user(user_id=079c41da73c14d9bb1396d93be2b9a06)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:45.962306 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a3810-abf1-423c-bdbb-ed9573ed0921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.963186 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3810-abf1-423c-bdbb-ed9573ed0921 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.963471 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3810-abf1-423c-bdbb-ed9573ed0921 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.963556 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b26cf0-7114-4ad1-9df0-62eafe2fbfc6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:45.963773 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3810-abf1-423c-bdbb-ed9573ed0921 None admin] PATH_INFO: `/v3/users/0b14190ea479428f9261f7330cd53b7f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.964957 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a3810-abf1-423c-bdbb-ed9573ed0921 None admin] RBAC: Authorizing `identity:get_user(user_id=0b14190ea479428f9261f7330cd53b7f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:45.965147 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 97/197] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:45 2022] GET /identity/v3/users/079c41da73c14d9bb1396d93be2b9a06 => generated 283 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:45.970082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b26cf0-7114-4ad1-9df0-62eafe2fbfc6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:45.970170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a3810-abf1-423c-bdbb-ed9573ed0921 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:45.970170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 101/198] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:45 2022] GET /identity/v3/users/0b14190ea479428f9261f7330cd53b7f => generated 289 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:45.970170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a3810-abf1-423c-bdbb-ed9573ed0921 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:46.067095 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b26cf0-7114-4ad1-9df0-62eafe2fbfc6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:46.068665 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a3810-abf1-423c-bdbb-ed9573ed0921 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:46.094024 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:46.100902 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381d300-c74e-48f0-be17-fc507c762586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:46.101547 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381d300-c74e-48f0-be17-fc507c762586 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:46.101835 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381d300-c74e-48f0-be17-fc507c762586 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:46.101984 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdff560-af6e-418b-b57f-7006ff0cf651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:46.102172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381d300-c74e-48f0-be17-fc507c762586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:46.102519 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdff560-af6e-418b-b57f-7006ff0cf651 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:46.102803 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdff560-af6e-418b-b57f-7006ff0cf651 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:46.103080 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdff560-af6e-418b-b57f-7006ff0cf651 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:46.103831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdff560-af6e-418b-b57f-7006ff0cf651 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:46.105301 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdff560-af6e-418b-b57f-7006ff0cf651 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:46.117826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:46.170192 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381d300-c74e-48f0-be17-fc507c762586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:46.171636 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381d300-c74e-48f0-be17-fc507c762586 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:46.179836 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 102/199] 10.222.0.43 () {60 vars in 1132 bytes} [Wed May 25 13:50:45 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:46.180652 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdff560-af6e-418b-b57f-7006ff0cf651 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:46.294477 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 98/200] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:50:46.294477 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381d300-c74e-48f0-be17-fc507c762586 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:46.323087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdff560-af6e-418b-b57f-7006ff0cf651 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:46.350561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:46.360808 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115778-fe7e-48bb-94f4-b1ce6bbce044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:46.361465 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115778-fe7e-48bb-94f4-b1ce6bbce044 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:46.364084 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115778-fe7e-48bb-94f4-b1ce6bbce044 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:46.364084 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115778-fe7e-48bb-94f4-b1ce6bbce044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:46.415073 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381d300-c74e-48f0-be17-fc507c762586 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:46.425669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:46.445454 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc115778-fe7e-48bb-94f4-b1ce6bbce044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:46.447468 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc115778-fe7e-48bb-94f4-b1ce6bbce044 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:46.461272 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72644d5e-f5aa-4d14-9685-6bb62451e69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:46.462544 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72644d5e-f5aa-4d14-9685-6bb62451e69b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:46.463095 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72644d5e-f5aa-4d14-9685-6bb62451e69b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:46.463095 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72644d5e-f5aa-4d14-9685-6bb62451e69b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:46.546748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72644d5e-f5aa-4d14-9685-6bb62451e69b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:46.548275 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72644d5e-f5aa-4d14-9685-6bb62451e69b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:46.576437 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 103/201] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:50:46.577808 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115778-fe7e-48bb-94f4-b1ce6bbce044 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:46.597947 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:46.670914 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:46.672262 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 99/202] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:50:46.673483 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72644d5e-f5aa-4d14-9685-6bb62451e69b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:46.692699 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115778-fe7e-48bb-94f4-b1ce6bbce044 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:46.730745 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fe42d-a6c4-4419-98e6-32c0a28d047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:46.731623 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fe42d-a6c4-4419-98e6-32c0a28d047f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:46.731951 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fe42d-a6c4-4419-98e6-32c0a28d047f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:46.732228 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fe42d-a6c4-4419-98e6-32c0a28d047f None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:46.733423 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fe42d-a6c4-4419-98e6-32c0a28d047f None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:46.735175 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fe42d-a6c4-4419-98e6-32c0a28d047f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:46.736994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 104/203] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:46 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:46.737766 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fe42d-a6c4-4419-98e6-32c0a28d047f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:46.780169 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72644d5e-f5aa-4d14-9685-6bb62451e69b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:46.815823 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e23ae-0f5e-46cc-95c7-3b43971e897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:46.816690 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e23ae-0f5e-46cc-95c7-3b43971e897e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:46.816971 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e23ae-0f5e-46cc-95c7-3b43971e897e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:46.817245 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e23ae-0f5e-46cc-95c7-3b43971e897e None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:46.819009 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e23ae-0f5e-46cc-95c7-3b43971e897e None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:46.820606 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e23ae-0f5e-46cc-95c7-3b43971e897e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:46.822604 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 100/204] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:46 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:46.823281 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e23ae-0f5e-46cc-95c7-3b43971e897e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:46.838918 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:46.847463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fe42d-a6c4-4419-98e6-32c0a28d047f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:46.888698 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874c24f-1b82-43d6-8fc2-329b9cd3105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:46.890428 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874c24f-1b82-43d6-8fc2-329b9cd3105c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:46.891015 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874c24f-1b82-43d6-8fc2-329b9cd3105c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:46.891442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874c24f-1b82-43d6-8fc2-329b9cd3105c None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:46.893277 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874c24f-1b82-43d6-8fc2-329b9cd3105c None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:46.895427 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874c24f-1b82-43d6-8fc2-329b9cd3105c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:46.898293 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 105/205] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:46 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:46.899270 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874c24f-1b82-43d6-8fc2-329b9cd3105c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:46.929660 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:46.959868 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e23ae-0f5e-46cc-95c7-3b43971e897e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:47.007362 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b93b01-bea5-47d8-928e-026a72b7991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:47.008420 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b93b01-bea5-47d8-928e-026a72b7991e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:47.008810 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b93b01-bea5-47d8-928e-026a72b7991e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:47.009189 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b93b01-bea5-47d8-928e-026a72b7991e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:47.010414 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b93b01-bea5-47d8-928e-026a72b7991e None admin] RBAC: Adding query filter params (role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5, scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9, user.id=079c41da73c14d9bb1396d93be2b9a06) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:47.010835 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b93b01-bea5-47d8-928e-026a72b7991e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:47.013191 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b93b01-bea5-47d8-928e-026a72b7991e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:47.020619 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 101/206] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:46 2022] GET /identity/v3/role_assignments?user.id=079c41da73c14d9bb1396d93be2b9a06&scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9&role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:47.022755 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b93b01-bea5-47d8-928e-026a72b7991e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:47.040137 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874c24f-1b82-43d6-8fc2-329b9cd3105c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:47.092538 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdc4be-6dfc-4846-8ab1-8c778392d288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:47.093291 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdc4be-6dfc-4846-8ab1-8c778392d288 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:47.093581 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdc4be-6dfc-4846-8ab1-8c778392d288 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:47.093907 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdc4be-6dfc-4846-8ab1-8c778392d288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:47.094766 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdc4be-6dfc-4846-8ab1-8c778392d288 None admin] RBAC: Adding query filter params (role.id=36d58da2a9494447b686349f4426d7d7, scope.project.id=66a86bd19c83439885fcd12d7fb788d3, user.id=0b14190ea479428f9261f7330cd53b7f) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:47.095089 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdc4be-6dfc-4846-8ab1-8c778392d288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:47.096978 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdc4be-6dfc-4846-8ab1-8c778392d288 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:47.113369 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 106/207] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:46 2022] GET /identity/v3/role_assignments?user.id=0b14190ea479428f9261f7330cd53b7f&scope.project.id=66a86bd19c83439885fcd12d7fb788d3&role.id=36d58da2a9494447b686349f4426d7d7 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:47.115560 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:47.143847 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b93b01-bea5-47d8-928e-026a72b7991e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:47.184495 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c926b53-9a54-4db6-85b2-757a0fbcdb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:47.186039 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c926b53-9a54-4db6-85b2-757a0fbcdb14 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:47.186522 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c926b53-9a54-4db6-85b2-757a0fbcdb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:47.186995 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c926b53-9a54-4db6-85b2-757a0fbcdb14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:47.188095 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c926b53-9a54-4db6-85b2-757a0fbcdb14 None admin] RBAC: Adding query filter params (role.id=9ba48b8364e040eb829f7c1e7662f8d3, scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9, user.id=079c41da73c14d9bb1396d93be2b9a06) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:47.188614 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c926b53-9a54-4db6-85b2-757a0fbcdb14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:47.190325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c926b53-9a54-4db6-85b2-757a0fbcdb14 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:47.198298 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 102/208] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:47 2022] GET /identity/v3/role_assignments?user.id=079c41da73c14d9bb1396d93be2b9a06&scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9&role.id=9ba48b8364e040eb829f7c1e7662f8d3 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:48.685932 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4841d3-edeb-4537-adfc-94a995bd99d6 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:48.686401 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4841d3-edeb-4537-adfc-94a995bd99d6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:48.686401 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4841d3-edeb-4537-adfc-94a995bd99d6 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:48.688091 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 107/209] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:48.693680 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dcb21-83c1-49cf-ba12-f3c153d6efa1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:48.694162 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dcb21-83c1-49cf-ba12-f3c153d6efa1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:48.694233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dcb21-83c1-49cf-ba12-f3c153d6efa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:48.712088 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-849dcb21-83c1-49cf-ba12-f3c153d6efa1 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:48.713286 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-849dcb21-83c1-49cf-ba12-f3c153d6efa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:48.768863 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f3ee6-8b0b-453f-9619-f11e9e8d6ce7 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:48.769257 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f3ee6-8b0b-453f-9619-f11e9e8d6ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:48.769608 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f3ee6-8b0b-453f-9619-f11e9e8d6ce7 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:48.771961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 108/210] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:50:48.777704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3efa4-9e34-4937-94c9-99f54ece53d6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:48.778207 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3efa4-9e34-4937-94c9-99f54ece53d6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:48.778664 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3efa4-9e34-4937-94c9-99f54ece53d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:48.793476 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 103/211] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:48.800998 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e4f3efa4-9e34-4937-94c9-99f54ece53d6 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:48.802598 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e4f3efa4-9e34-4937-94c9-99f54ece53d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:48.817210 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dcb21-83c1-49cf-ba12-f3c153d6efa1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:48.877333 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 109/212] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:50:48.894862 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:48.902808 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3efa4-9e34-4937-94c9-99f54ece53d6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:48.918083 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:48.936733 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dcb21-83c1-49cf-ba12-f3c153d6efa1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:48.983976 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87e684-dba9-4393-9786-01b8988ddfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:48.985545 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87e684-dba9-4393-9786-01b8988ddfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:48.986039 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87e684-dba9-4393-9786-01b8988ddfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:48.986906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87e684-dba9-4393-9786-01b8988ddfe8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:48.988575 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87e684-dba9-4393-9786-01b8988ddfe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:48.991059 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87e684-dba9-4393-9786-01b8988ddfe8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:48.993495 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 104/213] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:48.999363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87e684-dba9-4393-9786-01b8988ddfe8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:49.015464 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3efa4-9e34-4937-94c9-99f54ece53d6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:49.062598 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7ef20-c490-492f-9629-3774944bc3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:49.064065 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7ef20-c490-492f-9629-3774944bc3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.064815 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7ef20-c490-492f-9629-3774944bc3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.065322 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7ef20-c490-492f-9629-3774944bc3c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.081024 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7ef20-c490-492f-9629-3774944bc3c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f0f7ef20-c490-492f-9629-3774944bc3c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:49.092851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:49.093778 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:49.094575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:49.094575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:49.094575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:49.094575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:49.094575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:49.094575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:49.094575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:49.094575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:49.094575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:49.094575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:49.094575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:49.094575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:49.097277 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 110/214] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:50:49.104931 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7ef20-c490-492f-9629-3774944bc3c0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:49.132562 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87e684-dba9-4393-9786-01b8988ddfe8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:49.177932 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370153b-5869-420c-8d97-596f3d4d9af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:49.179239 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370153b-5869-420c-8d97-596f3d4d9af5 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.179842 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370153b-5869-420c-8d97-596f3d4d9af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.180311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370153b-5869-420c-8d97-596f3d4d9af5 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.181234 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370153b-5869-420c-8d97-596f3d4d9af5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:49.184055 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370153b-5869-420c-8d97-596f3d4d9af5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:49.196000 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:49.199605 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:49.221931 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7ef20-c490-492f-9629-3774944bc3c0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:49.257181 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26695e-6748-49be-a2af-a3e47f4b5d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:49.257857 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26695e-6748-49be-a2af-a3e47f4b5d93 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.258141 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26695e-6748-49be-a2af-a3e47f4b5d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.258418 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26695e-6748-49be-a2af-a3e47f4b5d93 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.259165 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26695e-6748-49be-a2af-a3e47f4b5d93 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:49.259475 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26695e-6748-49be-a2af-a3e47f4b5d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:49.260926 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26695e-6748-49be-a2af-a3e47f4b5d93 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:49.274896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 111/215] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:49.275984 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26695e-6748-49be-a2af-a3e47f4b5d93 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:49.289748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 105/216] 10.222.0.43 () {60 vars in 1132 bytes} [Wed May 25 13:50:48 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:50:49.397192 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26695e-6748-49be-a2af-a3e47f4b5d93 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:49.435009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f813e6-a89b-4f85-9863-148f3942ec40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:49.435993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f813e6-a89b-4f85-9863-148f3942ec40 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.436279 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f813e6-a89b-4f85-9863-148f3942ec40 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.436560 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f813e6-a89b-4f85-9863-148f3942ec40 None admin] PATH_INFO: `/v3/users/3a432c4549234237816b7680cea25d67` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.439669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:49.456849 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f813e6-a89b-4f85-9863-148f3942ec40 None admin] RBAC: Authorizing `identity:get_user(user_id=3a432c4549234237816b7680cea25d67)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:49.456849 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f813e6-a89b-4f85-9863-148f3942ec40 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:49.456849 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 112/217] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:49 2022] GET /identity/v3/users/3a432c4549234237816b7680cea25d67 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:49.462173 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370153b-5869-420c-8d97-596f3d4d9af5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:49.501801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831b502-d460-4623-9a76-d6ccb0094512 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.502127 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831b502-d460-4623-9a76-d6ccb0094512 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.502502 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831b502-d460-4623-9a76-d6ccb0094512 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.503845 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 113/218] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:49.511753 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3d7cf-0487-4f28-8cf2-6495f1aee9b0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.512198 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3d7cf-0487-4f28-8cf2-6495f1aee9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.512575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3d7cf-0487-4f28-8cf2-6495f1aee9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.531134 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a7d3d7cf-0487-4f28-8cf2-6495f1aee9b0 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:49.532411 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a7d3d7cf-0487-4f28-8cf2-6495f1aee9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:49.586288 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370153b-5869-420c-8d97-596f3d4d9af5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:49.617979 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 114/219] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:50:49.630930 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf19ad5-0d53-4a0e-a90f-234b2af2f155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:49.631832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19ad5-0d53-4a0e-a90f-234b2af2f155 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.632257 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19ad5-0d53-4a0e-a90f-234b2af2f155 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.632673 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19ad5-0d53-4a0e-a90f-234b2af2f155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.641493 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3d7cf-0487-4f28-8cf2-6495f1aee9b0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:49.716926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:49.726535 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf19ad5-0d53-4a0e-a90f-234b2af2f155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:49.728263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf19ad5-0d53-4a0e-a90f-234b2af2f155 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:49.763616 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3d7cf-0487-4f28-8cf2-6495f1aee9b0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:49.793721 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:49.806668 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de43a2a-7139-4e80-9187-b5b81c7d281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:49.807470 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43a2a-7139-4e80-9187-b5b81c7d281a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.807796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43a2a-7139-4e80-9187-b5b81c7d281a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.808241 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43a2a-7139-4e80-9187-b5b81c7d281a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.828638 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de43a2a-7139-4e80-9187-b5b81c7d281a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7de43a2a-7139-4e80-9187-b5b81c7d281a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:49.839599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:49.847054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:49.847879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:49.847879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:49.847879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:49.847879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:49.847879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:49.847879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:49.847879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:49.847879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:49.847879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:49.847879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:49.847879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:49.847879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:49.847879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 115/220] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:50:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:50:49.847879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bf5cf-09ac-4689-9a37-7384d55e38ba None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.848593 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bf5cf-09ac-4689-9a37-7384d55e38ba None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.848593 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bf5cf-09ac-4689-9a37-7384d55e38ba None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.851152 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 116/221] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:49.851152 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bf5cf-09ac-4689-9a37-7384d55e38ba None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:49.865904 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 106/222] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:50:49.867562 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f9cbc-6120-47e8-9836-7348f918ffdb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.867886 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f9cbc-6120-47e8-9836-7348f918ffdb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.868169 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f9cbc-6120-47e8-9836-7348f918ffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.893319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-290f9cbc-6120-47e8-9836-7348f918ffdb None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:49.895039 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-290f9cbc-6120-47e8-9836-7348f918ffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:49.966085 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bf5cf-09ac-4689-9a37-7384d55e38ba None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:49.975139 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 107/223] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:49.976496 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f9cbc-6120-47e8-9836-7348f918ffdb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:50.002236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c733fe-5124-44b1-a1b1-71d7ababd604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:50.002941 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c733fe-5124-44b1-a1b1-71d7ababd604 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:50.003313 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c733fe-5124-44b1-a1b1-71d7ababd604 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:50.003520 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c733fe-5124-44b1-a1b1-71d7ababd604 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:50.004279 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c733fe-5124-44b1-a1b1-71d7ababd604 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:50.004584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c733fe-5124-44b1-a1b1-71d7ababd604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:50.006653 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c733fe-5124-44b1-a1b1-71d7ababd604 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:50.007497 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:50.015975 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 117/224] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:50.021463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c733fe-5124-44b1-a1b1-71d7ababd604 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:50.073356 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:50.093295 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f9cbc-6120-47e8-9836-7348f918ffdb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:50.135295 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c733fe-5124-44b1-a1b1-71d7ababd604 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:50.138071 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c8204-4305-4935-a431-7754e29777be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:50.139161 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c8204-4305-4935-a431-7754e29777be None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:50.139619 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c8204-4305-4935-a431-7754e29777be None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:50.140095 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c8204-4305-4935-a431-7754e29777be None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:50.141577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c8204-4305-4935-a431-7754e29777be None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:50.143340 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c8204-4305-4935-a431-7754e29777be None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:50.151025 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 108/225] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:49 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:50.152205 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c8204-4305-4935-a431-7754e29777be None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:50.173504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147d1ec-f74e-4a62-afce-ddd98b54ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:50.174450 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147d1ec-f74e-4a62-afce-ddd98b54ac44 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:50.174802 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147d1ec-f74e-4a62-afce-ddd98b54ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:50.175145 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147d1ec-f74e-4a62-afce-ddd98b54ac44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:50.187469 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147d1ec-f74e-4a62-afce-ddd98b54ac44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9147d1ec-f74e-4a62-afce-ddd98b54ac44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:50.196937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:50.197833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:50.198599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:50.198599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:50.198599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:50.198599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:50.198599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:50.198599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:50.198599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:50.198599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:50.198599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:50.198599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:50.198599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:50:50.198599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:50.198599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 118/226] 10.222.0.43 () {56 vars in 1114 bytes} [Wed May 25 13:50:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:50.198599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147d1ec-f74e-4a62-afce-ddd98b54ac44 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:50.256576 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:50.265772 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c8204-4305-4935-a431-7754e29777be None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:50.305096 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c49c8c-363b-403f-b099-57e422737190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:50.305991 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c49c8c-363b-403f-b099-57e422737190 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:50.306275 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c49c8c-363b-403f-b099-57e422737190 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:50.306555 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c49c8c-363b-403f-b099-57e422737190 None admin] PATH_INFO: `/v3/users/079c41da73c14d9bb1396d93be2b9a06` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:50.307907 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c49c8c-363b-403f-b099-57e422737190 None admin] RBAC: Authorizing `identity:get_user(user_id=079c41da73c14d9bb1396d93be2b9a06)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:50.309464 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c49c8c-363b-403f-b099-57e422737190 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:50.316207 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 109/227] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:50 2022] GET /identity/v3/users/079c41da73c14d9bb1396d93be2b9a06 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:50.316207 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c49c8c-363b-403f-b099-57e422737190 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:50.326115 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147d1ec-f74e-4a62-afce-ddd98b54ac44 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:50.334354 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:50.365863 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a57ba0-2a5c-4a6b-a039-eaa30244f13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:50.366876 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57ba0-2a5c-4a6b-a039-eaa30244f13b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:50.367379 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57ba0-2a5c-4a6b-a039-eaa30244f13b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:50.367990 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57ba0-2a5c-4a6b-a039-eaa30244f13b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:50.369199 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a57ba0-2a5c-4a6b-a039-eaa30244f13b None admin] RBAC: Adding query filter params (role.id=997ba13b80634887b0a7e88cbf2b2e62, scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9, user.id=3a432c4549234237816b7680cea25d67) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:50.369703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a57ba0-2a5c-4a6b-a039-eaa30244f13b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:50.371372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a57ba0-2a5c-4a6b-a039-eaa30244f13b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:50.377692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 119/228] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:50 2022] GET /identity/v3/role_assignments?user.id=3a432c4549234237816b7680cea25d67&scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9&role.id=997ba13b80634887b0a7e88cbf2b2e62 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:50.378837 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a57ba0-2a5c-4a6b-a039-eaa30244f13b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:50.480718 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c49c8c-363b-403f-b099-57e422737190 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:50.523908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efb5b0-d71a-4112-b99b-76ab78817279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:50.525077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb5b0-d71a-4112-b99b-76ab78817279 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:50.525558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb5b0-d71a-4112-b99b-76ab78817279 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:50.526025 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb5b0-d71a-4112-b99b-76ab78817279 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:50.526976 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efb5b0-d71a-4112-b99b-76ab78817279 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:50.527477 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efb5b0-d71a-4112-b99b-76ab78817279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:50.529439 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efb5b0-d71a-4112-b99b-76ab78817279 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:50.540817 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 110/229] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:50:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:50.547738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efb5b0-d71a-4112-b99b-76ab78817279 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:50.603015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:50.615267 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a57ba0-2a5c-4a6b-a039-eaa30244f13b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:50.699948 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d16919-5e41-453d-ab4a-c6690d7f3072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:50.701242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d16919-5e41-453d-ab4a-c6690d7f3072 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:50.701721 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d16919-5e41-453d-ab4a-c6690d7f3072 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:50.702186 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d16919-5e41-453d-ab4a-c6690d7f3072 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:50.704624 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d16919-5e41-453d-ab4a-c6690d7f3072 None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:50.708970 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d16919-5e41-453d-ab4a-c6690d7f3072 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:50.712406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 120/230] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:50 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:50.728829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d16919-5e41-453d-ab4a-c6690d7f3072 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:50.740167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efb5b0-d71a-4112-b99b-76ab78817279 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:50.795109 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c7183-b7c2-4972-b76c-1c28c37a084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:50.796371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c7183-b7c2-4972-b76c-1c28c37a084f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:50.797451 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c7183-b7c2-4972-b76c-1c28c37a084f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:50.797923 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c7183-b7c2-4972-b76c-1c28c37a084f None admin] PATH_INFO: `/v3/users/079c41da73c14d9bb1396d93be2b9a06` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:50.799381 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c7183-b7c2-4972-b76c-1c28c37a084f None admin] RBAC: Authorizing `identity:get_user(user_id=079c41da73c14d9bb1396d93be2b9a06)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:50.801249 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c7183-b7c2-4972-b76c-1c28c37a084f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:50.803851 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 111/231] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:50 2022] GET /identity/v3/users/079c41da73c14d9bb1396d93be2b9a06 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:50.810504 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c7183-b7c2-4972-b76c-1c28c37a084f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:50.830065 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:50.905109 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d16919-5e41-453d-ab4a-c6690d7f3072 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:50.941552 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418ea82-b642-41c2-977f-91600551f386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:50.942876 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418ea82-b642-41c2-977f-91600551f386 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:50.943386 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418ea82-b642-41c2-977f-91600551f386 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:50.943970 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418ea82-b642-41c2-977f-91600551f386 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9/users/079c41da73c14d9bb1396d93be2b9a06/roles/cc4e2e441e3a4f67a7b4ed50677ecaa5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:50.946232 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418ea82-b642-41c2-977f-91600551f386 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c0322c32dc4d1b8292e7736aea59b9, user_id=079c41da73c14d9bb1396d93be2b9a06, role_id=cc4e2e441e3a4f67a7b4ed50677ecaa5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:50.947970 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418ea82-b642-41c2-977f-91600551f386 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:50.981049 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:50.985258 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c7183-b7c2-4972-b76c-1c28c37a084f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:51.025714 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 121/232] 10.222.0.43 () {58 vars in 1439 bytes} [Wed May 25 13:50:50 2022] PUT /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9/users/079c41da73c14d9bb1396d93be2b9a06/roles/cc4e2e441e3a4f67a7b4ed50677ecaa5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:50:51.031997 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097972af-982c-4ba0-83d5-e6e92ee222af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:51.032975 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097972af-982c-4ba0-83d5-e6e92ee222af None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:51.033257 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097972af-982c-4ba0-83d5-e6e92ee222af None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:51.033527 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097972af-982c-4ba0-83d5-e6e92ee222af None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:51.034781 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097972af-982c-4ba0-83d5-e6e92ee222af None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:51.036979 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097972af-982c-4ba0-83d5-e6e92ee222af None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:51.039015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 112/233] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:50 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:51.044955 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418ea82-b642-41c2-977f-91600551f386 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:51.180474 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:51.184664 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418ea82-b642-41c2-977f-91600551f386 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:51.222098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9edf3-fb12-4b94-9dde-33a5c0c447f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:51.223006 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9edf3-fb12-4b94-9dde-33a5c0c447f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:51.223359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9edf3-fb12-4b94-9dde-33a5c0c447f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:51.223633 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9edf3-fb12-4b94-9dde-33a5c0c447f7 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9/users/079c41da73c14d9bb1396d93be2b9a06/roles/9ba48b8364e040eb829f7c1e7662f8d3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:51.226328 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9edf3-fb12-4b94-9dde-33a5c0c447f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c0322c32dc4d1b8292e7736aea59b9, user_id=079c41da73c14d9bb1396d93be2b9a06, role_id=9ba48b8364e040eb829f7c1e7662f8d3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:51.227890 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9edf3-fb12-4b94-9dde-33a5c0c447f7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:51.328214 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 122/234] 10.222.0.43 () {58 vars in 1439 bytes} [Wed May 25 13:50:51 2022] PUT /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9/users/079c41da73c14d9bb1396d93be2b9a06/roles/9ba48b8364e040eb829f7c1e7662f8d3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:52.125060 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1847ea0-c1d7-4e96-9b64-374b5a9d6907 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:52.125593 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1847ea0-c1d7-4e96-9b64-374b5a9d6907 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:52.125593 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1847ea0-c1d7-4e96-9b64-374b5a9d6907 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:52.126979 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 113/235] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:52.132840 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be98b-8ccf-4633-87f1-5a5334910d6a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:52.133229 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be98b-8ccf-4633-87f1-5a5334910d6a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:52.133419 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be98b-8ccf-4633-87f1-5a5334910d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:52.159843 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-db6be98b-8ccf-4633-87f1-5a5334910d6a None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:52.161019 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-db6be98b-8ccf-4633-87f1-5a5334910d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:52.178699 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e046d-bcf6-40c3-8e6e-ea71be491a3b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:52.178981 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e046d-bcf6-40c3-8e6e-ea71be491a3b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:52.179258 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e046d-bcf6-40c3-8e6e-ea71be491a3b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:52.180661 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 114/236] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:52.188991 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517308a9-6cef-40d6-92a3-8889202b215b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:52.189285 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517308a9-6cef-40d6-92a3-8889202b215b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:52.189571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517308a9-6cef-40d6-92a3-8889202b215b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:52.206560 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-517308a9-6cef-40d6-92a3-8889202b215b None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:52.207756 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-517308a9-6cef-40d6-92a3-8889202b215b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:52.289134 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 123/237] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:52.319627 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 115/238] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:52.327477 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6be98b-8ccf-4633-87f1-5a5334910d6a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:52.357120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517308a9-6cef-40d6-92a3-8889202b215b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:52.488192 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:52.496885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6be98b-8ccf-4633-87f1-5a5334910d6a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:52.513378 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:52.535583 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517308a9-6cef-40d6-92a3-8889202b215b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:52.558923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e4538-c426-4ef6-8f11-6b97266c157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:52.559747 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e4538-c426-4ef6-8f11-6b97266c157b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:52.560026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e4538-c426-4ef6-8f11-6b97266c157b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:52.560302 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e4538-c426-4ef6-8f11-6b97266c157b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:52.561475 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e4538-c426-4ef6-8f11-6b97266c157b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:52.572461 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e4538-c426-4ef6-8f11-6b97266c157b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:52.572461 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 124/239] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:52.573140 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e4538-c426-4ef6-8f11-6b97266c157b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:52.606715 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbc393-e10a-47a6-a573-360d1726ba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:52.607520 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbc393-e10a-47a6-a573-360d1726ba22 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:52.607840 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbc393-e10a-47a6-a573-360d1726ba22 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:52.608125 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbc393-e10a-47a6-a573-360d1726ba22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:52.626706 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbc393-e10a-47a6-a573-360d1726ba22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-eafbc393-e10a-47a6-a573-360d1726ba22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:52.635097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:52.636140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:52.636908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:52.636908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:52.636908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:52.636908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:52.636908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:52.636908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:52.636908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:52.636908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:52.636908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:52.636908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:52.636908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:50:52.636908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:52.636908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 116/240] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:50:52.642112 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbc393-e10a-47a6-a573-360d1726ba22 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:52.711761 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e4538-c426-4ef6-8f11-6b97266c157b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:52.752313 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8947c-a595-4d94-a328-3823cb83768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:52.752923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8947c-a595-4d94-a328-3823cb83768d None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:52.753268 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8947c-a595-4d94-a328-3823cb83768d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:52.753550 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8947c-a595-4d94-a328-3823cb83768d None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:52.754319 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8947c-a595-4d94-a328-3823cb83768d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:52.757405 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8947c-a595-4d94-a328-3823cb83768d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:52.823502 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbc393-e10a-47a6-a573-360d1726ba22 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:52.860078 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e67ebb-8b2c-42fe-8695-4f86129b96a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:52.860788 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e67ebb-8b2c-42fe-8695-4f86129b96a7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:52.861080 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e67ebb-8b2c-42fe-8695-4f86129b96a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:52.861359 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e67ebb-8b2c-42fe-8695-4f86129b96a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:52.862111 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e67ebb-8b2c-42fe-8695-4f86129b96a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:52.862424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e67ebb-8b2c-42fe-8695-4f86129b96a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:52.863853 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e67ebb-8b2c-42fe-8695-4f86129b96a7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:52.877158 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 125/241] 10.222.0.43 () {60 vars in 1132 bytes} [Wed May 25 13:50:52 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:52.881540 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 117/242] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:52.888997 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8947c-a595-4d94-a328-3823cb83768d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:52.913162 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:52.939685 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd5f66-7e64-4856-97a4-f6930189057a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:52.940046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd5f66-7e64-4856-97a4-f6930189057a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:52.940324 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd5f66-7e64-4856-97a4-f6930189057a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:52.942144 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 118/243] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:52.948635 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f12b2-26c7-47b3-a589-7e43cb765d91 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:52.949290 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f12b2-26c7-47b3-a589-7e43cb765d91 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:52.949770 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f12b2-26c7-47b3-a589-7e43cb765d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:52.968767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-835f12b2-26c7-47b3-a589-7e43cb765d91 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:52.970335 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-835f12b2-26c7-47b3-a589-7e43cb765d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:52.975371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:53.073854 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 119/244] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:53.075706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8947c-a595-4d94-a328-3823cb83768d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.105106 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f12b2-26c7-47b3-a589-7e43cb765d91 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.117211 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc846332-51ea-4735-9b56-95b1fc16a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.118427 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846332-51ea-4735-9b56-95b1fc16a308 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.118979 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846332-51ea-4735-9b56-95b1fc16a308 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.119413 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846332-51ea-4735-9b56-95b1fc16a308 None admin] PATH_INFO: `/v3/users/9bbff3d3d2a144e98a99002551f4bbe8` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.136928 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc846332-51ea-4735-9b56-95b1fc16a308 None admin] RBAC: Authorizing `identity:get_user(user_id=9bbff3d3d2a144e98a99002551f4bbe8)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:53.139205 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc846332-51ea-4735-9b56-95b1fc16a308 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:53.141690 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 126/245] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:52 2022] GET /identity/v3/users/9bbff3d3d2a144e98a99002551f4bbe8 => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:53.148280 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc846332-51ea-4735-9b56-95b1fc16a308 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.234594 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f12b2-26c7-47b3-a589-7e43cb765d91 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.240467 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:53.275755 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc846332-51ea-4735-9b56-95b1fc16a308 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.275978 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476b256-e031-464b-8324-e8ba816670d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.276790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476b256-e031-464b-8324-e8ba816670d9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.277072 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476b256-e031-464b-8324-e8ba816670d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.277344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476b256-e031-464b-8324-e8ba816670d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.286558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:53.290136 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476b256-e031-464b-8324-e8ba816670d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6476b256-e031-464b-8324-e8ba816670d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:53.300543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:53.301610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:53.305067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:53.305067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:53.305067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:53.305067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:53.305067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:53.305067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:53.305067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:53.305067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:53.305067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:53.305067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:53.305067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:53.305067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:53.305067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 120/246] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:50:53.308054 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476b256-e031-464b-8324-e8ba816670d9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.322846 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db214f-fc56-481d-acba-483cbb38319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.323958 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db214f-fc56-481d-acba-483cbb38319b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.324478 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db214f-fc56-481d-acba-483cbb38319b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.324938 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db214f-fc56-481d-acba-483cbb38319b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.425061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db214f-fc56-481d-acba-483cbb38319b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:53.427102 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db214f-fc56-481d-acba-483cbb38319b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:53.449673 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476b256-e031-464b-8324-e8ba816670d9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.489301 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f79ded-4f30-478b-8a7a-6850d0994b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.490889 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f79ded-4f30-478b-8a7a-6850d0994b6f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.491381 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f79ded-4f30-478b-8a7a-6850d0994b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.491926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f79ded-4f30-478b-8a7a-6850d0994b6f None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.492906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f79ded-4f30-478b-8a7a-6850d0994b6f None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:53.493423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f79ded-4f30-478b-8a7a-6850d0994b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:53.495158 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f79ded-4f30-478b-8a7a-6850d0994b6f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:53.508959 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 121/247] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:53.514957 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f79ded-4f30-478b-8a7a-6850d0994b6f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.529728 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:53.570481 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 127/248] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:50:53.575746 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db214f-fc56-481d-acba-483cbb38319b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.606491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:53.665018 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f79ded-4f30-478b-8a7a-6850d0994b6f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.711986 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db214f-fc56-481d-acba-483cbb38319b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.713411 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a91b8-0c67-4d29-8101-471d6a0cb28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.715468 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a91b8-0c67-4d29-8101-471d6a0cb28c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.716173 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a91b8-0c67-4d29-8101-471d6a0cb28c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.716592 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a91b8-0c67-4d29-8101-471d6a0cb28c None admin] PATH_INFO: `/v3/users/3a432c4549234237816b7680cea25d67` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.717983 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a91b8-0c67-4d29-8101-471d6a0cb28c None admin] RBAC: Authorizing `identity:get_user(user_id=3a432c4549234237816b7680cea25d67)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:53.719626 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a91b8-0c67-4d29-8101-471d6a0cb28c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:53.721942 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 122/249] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:53 2022] GET /identity/v3/users/3a432c4549234237816b7680cea25d67 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:53.728252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a91b8-0c67-4d29-8101-471d6a0cb28c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.751606 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7715e-b73e-4a3f-a8c9-35602b1dadf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.753362 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7715e-b73e-4a3f-a8c9-35602b1dadf2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.754189 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7715e-b73e-4a3f-a8c9-35602b1dadf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.754840 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7715e-b73e-4a3f-a8c9-35602b1dadf2 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.756564 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7715e-b73e-4a3f-a8c9-35602b1dadf2 None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:53.759155 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7715e-b73e-4a3f-a8c9-35602b1dadf2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:53.761139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 128/250] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:53 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:53.769412 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7715e-b73e-4a3f-a8c9-35602b1dadf2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.826794 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:53.876189 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a91b8-0c67-4d29-8101-471d6a0cb28c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.892008 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7715e-b73e-4a3f-a8c9-35602b1dadf2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.907510 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:53.914171 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6044b9c-27bb-41a4-8af5-f3729a21cf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.915051 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6044b9c-27bb-41a4-8af5-f3729a21cf83 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.915339 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6044b9c-27bb-41a4-8af5-f3729a21cf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.915619 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6044b9c-27bb-41a4-8af5-f3729a21cf83 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.916866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6044b9c-27bb-41a4-8af5-f3729a21cf83 None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:53.918348 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6044b9c-27bb-41a4-8af5-f3729a21cf83 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:53.920089 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 123/251] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:53 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:53.921396 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a02a-1a2f-4ece-bdb2-1bbaafcab246 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.921684 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a02a-1a2f-4ece-bdb2-1bbaafcab246 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.921963 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a02a-1a2f-4ece-bdb2-1bbaafcab246 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.931606 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 124/252] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:53.931606 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19a02a-1a2f-4ece-bdb2-1bbaafcab246 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.936200 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581f602-0577-4326-8777-d9f3c15110f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.937185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581f602-0577-4326-8777-d9f3c15110f4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.937665 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581f602-0577-4326-8777-d9f3c15110f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.938166 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581f602-0577-4326-8777-d9f3c15110f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.939243 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581f602-0577-4326-8777-d9f3c15110f4 None admin] RBAC: Adding query filter params (role.id=36d58da2a9494447b686349f4426d7d7, scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9, user.id=9bbff3d3d2a144e98a99002551f4bbe8) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:53.939851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581f602-0577-4326-8777-d9f3c15110f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:53.942746 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581f602-0577-4326-8777-d9f3c15110f4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:53.949624 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 129/253] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:53 2022] GET /identity/v3/role_assignments?user.id=9bbff3d3d2a144e98a99002551f4bbe8&scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9&role.id=36d58da2a9494447b686349f4426d7d7 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:53.951337 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2befc6-ef06-4f1d-86ef-17609bcbec7e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.951888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2befc6-ef06-4f1d-86ef-17609bcbec7e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.952364 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2befc6-ef06-4f1d-86ef-17609bcbec7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.977871 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8e2befc6-ef06-4f1d-86ef-17609bcbec7e None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:53.979491 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8e2befc6-ef06-4f1d-86ef-17609bcbec7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:54.076069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 130/254] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:54.113352 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2befc6-ef06-4f1d-86ef-17609bcbec7e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:54.113516 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19a02a-1a2f-4ece-bdb2-1bbaafcab246 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:54.166620 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0d6f-dc1b-4868-a802-a862d3e4185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:54.167534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0d6f-dc1b-4868-a802-a862d3e4185f None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.167846 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0d6f-dc1b-4868-a802-a862d3e4185f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.168123 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0d6f-dc1b-4868-a802-a862d3e4185f None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9/users/3a432c4549234237816b7680cea25d67/roles/997ba13b80634887b0a7e88cbf2b2e62` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.170525 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f0d6f-dc1b-4868-a802-a862d3e4185f None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c0322c32dc4d1b8292e7736aea59b9, user_id=3a432c4549234237816b7680cea25d67, role_id=997ba13b80634887b0a7e88cbf2b2e62)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:54.172058 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f0d6f-dc1b-4868-a802-a862d3e4185f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:54.194522 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:54.278086 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 125/255] 10.222.0.43 () {58 vars in 1439 bytes} [Wed May 25 13:50:53 2022] PUT /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9/users/3a432c4549234237816b7680cea25d67/roles/997ba13b80634887b0a7e88cbf2b2e62 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:54.312384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2befc6-ef06-4f1d-86ef-17609bcbec7e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:54.367558 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebb390-5c83-46cc-8057-ec8e4c54c0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:54.368766 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebb390-5c83-46cc-8057-ec8e4c54c0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.369256 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebb390-5c83-46cc-8057-ec8e4c54c0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.369807 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebb390-5c83-46cc-8057-ec8e4c54c0f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.387824 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebb390-5c83-46cc-8057-ec8e4c54c0f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-72ebb390-5c83-46cc-8057-ec8e4c54c0f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:54.397831 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:54.398827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:54.399613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:54.399613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:54.399613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:54.399613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:54.399613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:54.399613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:54.399613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:54.399613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:54.399613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:54.399613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:54.399613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:50:54.399613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:54.407250 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 131/256] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:50:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:54.412922 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0d6f-dc1b-4868-a802-a862d3e4185f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:54.499327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:54.549183 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0d6f-dc1b-4868-a802-a862d3e4185f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:54.601853 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118f8ed-86ae-4376-8e52-6e1d8972d9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:54.602559 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118f8ed-86ae-4376-8e52-6e1d8972d9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.603329 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118f8ed-86ae-4376-8e52-6e1d8972d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.603608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118f8ed-86ae-4376-8e52-6e1d8972d9c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.604405 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118f8ed-86ae-4376-8e52-6e1d8972d9c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:54.605120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118f8ed-86ae-4376-8e52-6e1d8972d9c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:54.606552 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118f8ed-86ae-4376-8e52-6e1d8972d9c0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:54.617882 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 126/257] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:54.623871 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebb390-5c83-46cc-8057-ec8e4c54c0f1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:54.741450 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:54.753609 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebb390-5c83-46cc-8057-ec8e4c54c0f1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:54.788014 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545944e-dc07-4d42-afe4-5c477037b427 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.788625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545944e-dc07-4d42-afe4-5c477037b427 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.789338 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545944e-dc07-4d42-afe4-5c477037b427 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.791951 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 127/258] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:50:54.797526 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff222cf2-7859-4753-9f0d-8297f7953c1a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.797794 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff222cf2-7859-4753-9f0d-8297f7953c1a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.798081 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff222cf2-7859-4753-9f0d-8297f7953c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.800188 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ccef4-b8d1-4840-b484-0cd6f8384bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:54.801390 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ccef4-b8d1-4840-b484-0cd6f8384bcb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.802052 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ccef4-b8d1-4840-b484-0cd6f8384bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.802534 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ccef4-b8d1-4840-b484-0cd6f8384bcb None admin] PATH_INFO: `/v3/users/079c41da73c14d9bb1396d93be2b9a06` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.805983 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ccef4-b8d1-4840-b484-0cd6f8384bcb None admin] RBAC: Authorizing `identity:get_user(user_id=079c41da73c14d9bb1396d93be2b9a06)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:54.807485 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ccef4-b8d1-4840-b484-0cd6f8384bcb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:54.809207 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 132/259] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:54 2022] GET /identity/v3/users/079c41da73c14d9bb1396d93be2b9a06 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:54.817055 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ccef4-b8d1-4840-b484-0cd6f8384bcb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:54.830232 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ff222cf2-7859-4753-9f0d-8297f7953c1a None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:54.831447 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ff222cf2-7859-4753-9f0d-8297f7953c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:55.001501 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 128/260] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:55.037183 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff222cf2-7859-4753-9f0d-8297f7953c1a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:55.046607 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ccef4-b8d1-4840-b484-0cd6f8384bcb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:55.113899 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dc731-efef-4eb8-947b-f24601b9ecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:55.115023 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dc731-efef-4eb8-947b-f24601b9ecdd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:55.115700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dc731-efef-4eb8-947b-f24601b9ecdd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:55.116191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dc731-efef-4eb8-947b-f24601b9ecdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:55.176588 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:55.179484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:55.245853 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dc731-efef-4eb8-947b-f24601b9ecdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:55.248421 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dc731-efef-4eb8-947b-f24601b9ecdd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:55.301662 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff222cf2-7859-4753-9f0d-8297f7953c1a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:55.400580 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e295c59-03b0-4762-a812-cd354ea052a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:55.401421 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e295c59-03b0-4762-a812-cd354ea052a2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:55.401709 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e295c59-03b0-4762-a812-cd354ea052a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:55.401987 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e295c59-03b0-4762-a812-cd354ea052a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:55.422380 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e295c59-03b0-4762-a812-cd354ea052a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1e295c59-03b0-4762-a812-cd354ea052a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:55.432233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:55.433170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:55.433952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:55.433952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:55.433952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:55.433952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:55.433952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:55.433952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:55.433952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:55.433952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:55.433952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:55.433952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:55.433952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:50:55.433952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:55.433952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 129/261] 10.222.0.43 () {56 vars in 1114 bytes} [Wed May 25 13:50:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:50:55.440647 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e295c59-03b0-4762-a812-cd354ea052a2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:55.465156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 133/262] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:50:55.467960 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dc731-efef-4eb8-947b-f24601b9ecdd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:55.569832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:55.641430 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dc731-efef-4eb8-947b-f24601b9ecdd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:55.680514 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471755-dc82-42b8-8194-1f39d0e95a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:55.681390 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471755-dc82-42b8-8194-1f39d0e95a5e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:55.681678 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471755-dc82-42b8-8194-1f39d0e95a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:55.681961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471755-dc82-42b8-8194-1f39d0e95a5e None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:55.683368 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb471755-dc82-42b8-8194-1f39d0e95a5e None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:55.684887 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb471755-dc82-42b8-8194-1f39d0e95a5e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:55.693613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 134/263] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:55 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:55.696014 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471755-dc82-42b8-8194-1f39d0e95a5e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:55.698331 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e295c59-03b0-4762-a812-cd354ea052a2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:55.720046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:55.774303 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940163a-0e49-4494-9429-454e8637dca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:55.774989 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940163a-0e49-4494-9429-454e8637dca9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:55.775464 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940163a-0e49-4494-9429-454e8637dca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:55.775742 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940163a-0e49-4494-9429-454e8637dca9 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:55.776831 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940163a-0e49-4494-9429-454e8637dca9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:55.777154 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940163a-0e49-4494-9429-454e8637dca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:55.778553 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940163a-0e49-4494-9429-454e8637dca9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:55.799148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 130/264] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:50:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:55.805325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940163a-0e49-4494-9429-454e8637dca9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:55.945992 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471755-dc82-42b8-8194-1f39d0e95a5e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:56.013204 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:56.039302 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957b5be-25b9-4734-96f6-24f3572d2742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:56.040007 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957b5be-25b9-4734-96f6-24f3572d2742 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:56.040316 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957b5be-25b9-4734-96f6-24f3572d2742 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:56.040597 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957b5be-25b9-4734-96f6-24f3572d2742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:56.041443 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957b5be-25b9-4734-96f6-24f3572d2742 None admin] RBAC: Adding query filter params (role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5, scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9, user.id=079c41da73c14d9bb1396d93be2b9a06) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:56.041766 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957b5be-25b9-4734-96f6-24f3572d2742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:56.043258 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957b5be-25b9-4734-96f6-24f3572d2742 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:56.051527 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940163a-0e49-4494-9429-454e8637dca9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:56.057156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 135/265] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:55 2022] GET /identity/v3/role_assignments?user.id=079c41da73c14d9bb1396d93be2b9a06&scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9&role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5 => generated 608 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:56.126035 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023083eb-996d-495f-9638-7c72727d1741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:56.126944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023083eb-996d-495f-9638-7c72727d1741 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:56.127226 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023083eb-996d-495f-9638-7c72727d1741 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:56.127504 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023083eb-996d-495f-9638-7c72727d1741 None admin] PATH_INFO: `/v3/users/079c41da73c14d9bb1396d93be2b9a06` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:56.132769 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023083eb-996d-495f-9638-7c72727d1741 None admin] RBAC: Authorizing `identity:get_user(user_id=079c41da73c14d9bb1396d93be2b9a06)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:56.134295 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023083eb-996d-495f-9638-7c72727d1741 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:56.136179 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 131/266] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:55 2022] GET /identity/v3/users/079c41da73c14d9bb1396d93be2b9a06 => generated 283 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:56.142037 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957b5be-25b9-4734-96f6-24f3572d2742 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:56.282126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957b5be-25b9-4734-96f6-24f3572d2742 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:56.336506 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa094b-84ff-44ac-b7d9-a58fb828ffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:56.337181 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa094b-84ff-44ac-b7d9-a58fb828ffff None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:56.337494 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa094b-84ff-44ac-b7d9-a58fb828ffff None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:56.337771 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa094b-84ff-44ac-b7d9-a58fb828ffff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:56.416181 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:56.425838 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa094b-84ff-44ac-b7d9-a58fb828ffff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:56.427390 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa094b-84ff-44ac-b7d9-a58fb828ffff None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:56.547462 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 136/267] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:50:56.553627 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023083eb-996d-495f-9638-7c72727d1741 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:56.623157 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:56.629167 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb55a-670b-44fc-bb49-c15c32f292cf None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:56.629994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb55a-670b-44fc-bb49-c15c32f292cf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:56.630497 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb55a-670b-44fc-bb49-c15c32f292cf None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:56.632237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 137/268] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:56.637762 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fae05-96bb-4f8a-a8ea-46fd6ee3ab5d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:56.638411 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fae05-96bb-4f8a-a8ea-46fd6ee3ab5d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:56.638851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fae05-96bb-4f8a-a8ea-46fd6ee3ab5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:56.676384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-414fae05-96bb-4f8a-a8ea-46fd6ee3ab5d None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:56.678772 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-414fae05-96bb-4f8a-a8ea-46fd6ee3ab5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:56.743999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023083eb-996d-495f-9638-7c72727d1741 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:56.796955 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac6217-61f6-473d-ba7d-23fce8f9e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:56.797868 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac6217-61f6-473d-ba7d-23fce8f9e05d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:56.798095 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac6217-61f6-473d-ba7d-23fce8f9e05d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:56.798394 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac6217-61f6-473d-ba7d-23fce8f9e05d None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:56.803045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac6217-61f6-473d-ba7d-23fce8f9e05d None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:56.804524 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac6217-61f6-473d-ba7d-23fce8f9e05d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:56.806500 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 132/269] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:56 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:56.814654 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac6217-61f6-473d-ba7d-23fce8f9e05d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:56.834653 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 138/270] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:50:56.835865 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527902dd-837e-49a8-a2a8-f7e92699db81 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:56.836152 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527902dd-837e-49a8-a2a8-f7e92699db81 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:56.836585 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527902dd-837e-49a8-a2a8-f7e92699db81 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:56.838024 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 139/271] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:56.844046 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25401f35-926e-46b5-bbd5-7736996f6240 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:56.844507 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25401f35-926e-46b5-bbd5-7736996f6240 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:56.844931 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25401f35-926e-46b5-bbd5-7736996f6240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:56.862404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-25401f35-926e-46b5-bbd5-7736996f6240 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:56.863916 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-25401f35-926e-46b5-bbd5-7736996f6240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:56.882948 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:56.940149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac6217-61f6-473d-ba7d-23fce8f9e05d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:56.948669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 140/272] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:50:56.949786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25401f35-926e-46b5-bbd5-7736996f6240 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:56.959747 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:56.993834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd0157-d2aa-4cac-bc11-b9b09ad0cc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:56.994673 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd0157-d2aa-4cac-bc11-b9b09ad0cc7a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:56.994783 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd0157-d2aa-4cac-bc11-b9b09ad0cc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:56.995024 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd0157-d2aa-4cac-bc11-b9b09ad0cc7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:56.995881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd0157-d2aa-4cac-bc11-b9b09ad0cc7a None admin] RBAC: Adding query filter params (role.id=9ba48b8364e040eb829f7c1e7662f8d3, scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9, user.id=079c41da73c14d9bb1396d93be2b9a06) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:56.996193 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd0157-d2aa-4cac-bc11-b9b09ad0cc7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:56.997648 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd0157-d2aa-4cac-bc11-b9b09ad0cc7a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:57.007470 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 133/273] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:56 2022] GET /identity/v3/role_assignments?user.id=079c41da73c14d9bb1396d93be2b9a06&scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9&role.id=9ba48b8364e040eb829f7c1e7662f8d3 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:57.008354 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd0157-d2aa-4cac-bc11-b9b09ad0cc7a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:57.077470 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25401f35-926e-46b5-bbd5-7736996f6240 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:57.120892 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd6d78-8ed8-4c38-a512-20c78e1f9796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:57.121705 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd6d78-8ed8-4c38-a512-20c78e1f9796 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:57.121986 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd6d78-8ed8-4c38-a512-20c78e1f9796 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:57.122258 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd6d78-8ed8-4c38-a512-20c78e1f9796 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:57.123577 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd6d78-8ed8-4c38-a512-20c78e1f9796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:57.125110 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd6d78-8ed8-4c38-a512-20c78e1f9796 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:57.126941 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 141/274] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:50:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:57.128136 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b8e8f-e357-499e-b488-3855cbdfd5cf None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:57.128423 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b8e8f-e357-499e-b488-3855cbdfd5cf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:57.128702 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b8e8f-e357-499e-b488-3855cbdfd5cf None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:57.130895 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 142/275] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:57.134909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd0157-d2aa-4cac-bc11-b9b09ad0cc7a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:57.136229 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b8e8f-e357-499e-b488-3855cbdfd5cf None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:57.162645 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:57.185709 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506322ef-3b05-4a18-9980-a5ed0d572844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:57.187064 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506322ef-3b05-4a18-9980-a5ed0d572844 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:57.187554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506322ef-3b05-4a18-9980-a5ed0d572844 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:57.187995 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506322ef-3b05-4a18-9980-a5ed0d572844 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:57.204301 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506322ef-3b05-4a18-9980-a5ed0d572844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-506322ef-3b05-4a18-9980-a5ed0d572844 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:57.216916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:57.218577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:57.220034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:57.220034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:57.220034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:57.220034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:57.220034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:57.220034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:57.220034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:57.220034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:57.220034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:57.220034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:57.220034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:57.220034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:50:57.220034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 134/276] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:57.220034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c902a2-635f-47ce-bf58-a4086a7fcf37 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:57.229697 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c902a2-635f-47ce-bf58-a4086a7fcf37 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:57.229697 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c902a2-635f-47ce-bf58-a4086a7fcf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:57.242369 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-86c902a2-635f-47ce-bf58-a4086a7fcf37 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:57.243777 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-86c902a2-635f-47ce-bf58-a4086a7fcf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:57.276427 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:57.319854 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b8e8f-e357-499e-b488-3855cbdfd5cf None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:57.333019 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 135/277] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:57.333891 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c902a2-635f-47ce-bf58-a4086a7fcf37 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:57.372694 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073471a-5690-42a8-9d71-683e06b6ad7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:57.372694 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073471a-5690-42a8-9d71-683e06b6ad7f None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:57.373087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073471a-5690-42a8-9d71-683e06b6ad7f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:57.373298 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073471a-5690-42a8-9d71-683e06b6ad7f None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:57.374024 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073471a-5690-42a8-9d71-683e06b6ad7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:57.377997 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073471a-5690-42a8-9d71-683e06b6ad7f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:57.449618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c902a2-635f-47ce-bf58-a4086a7fcf37 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:57.454420 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 143/278] 10.222.0.43 () {60 vars in 1132 bytes} [Wed May 25 13:50:57 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:57.463396 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073471a-5690-42a8-9d71-683e06b6ad7f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:57.506166 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cb7a1-7160-48fc-9dd6-3a19dd66d0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:57.506898 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cb7a1-7160-48fc-9dd6-3a19dd66d0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:57.507180 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cb7a1-7160-48fc-9dd6-3a19dd66d0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:57.507453 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cb7a1-7160-48fc-9dd6-3a19dd66d0c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:57.508259 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cb7a1-7160-48fc-9dd6-3a19dd66d0c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:57.508566 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cb7a1-7160-48fc-9dd6-3a19dd66d0c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:57.510162 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cb7a1-7160-48fc-9dd6-3a19dd66d0c8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:57.525321 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 136/279] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:57.526877 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cb7a1-7160-48fc-9dd6-3a19dd66d0c8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:57.559257 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:57.560749 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:57.586106 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073471a-5690-42a8-9d71-683e06b6ad7f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:57.625176 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa026eb-9c4e-44e8-be9c-1b2283239f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:57.626047 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa026eb-9c4e-44e8-be9c-1b2283239f4d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:57.626379 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa026eb-9c4e-44e8-be9c-1b2283239f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:57.626656 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa026eb-9c4e-44e8-be9c-1b2283239f4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:57.639137 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa026eb-9c4e-44e8-be9c-1b2283239f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:57.646056 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cb7a1-7160-48fc-9dd6-3a19dd66d0c8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-efa026eb-9c4e-44e8-be9c-1b2283239f4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:57.647692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:57.648811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:57.649640 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:57.649640 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:57.649640 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:57.649640 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:57.649640 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:57.649640 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:57.649640 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:57.649640 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:57.649640 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:57.649640 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:57.649640 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:50:57.649640 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:57.649640 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 144/280] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:57.650310 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06771-312c-4e42-a29a-87e1b97e4506 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:57.650769 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06771-312c-4e42-a29a-87e1b97e4506 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:57.650769 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06771-312c-4e42-a29a-87e1b97e4506 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:57.652169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 145/281] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:57.656251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e06771-312c-4e42-a29a-87e1b97e4506 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:57.698274 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983becc-5df0-48c0-9c5f-3ca2ce8e9c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:57.699147 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983becc-5df0-48c0-9c5f-3ca2ce8e9c2e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:57.699430 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983becc-5df0-48c0-9c5f-3ca2ce8e9c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:57.699697 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983becc-5df0-48c0-9c5f-3ca2ce8e9c2e None admin] PATH_INFO: `/v3/users/0221f0f281a0420084d49b5049b4c0dd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:57.721507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983becc-5df0-48c0-9c5f-3ca2ce8e9c2e None admin] RBAC: Authorizing `identity:get_user(user_id=0221f0f281a0420084d49b5049b4c0dd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:57.723085 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983becc-5df0-48c0-9c5f-3ca2ce8e9c2e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:57.725858 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 137/282] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:57 2022] GET /identity/v3/users/0221f0f281a0420084d49b5049b4c0dd => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:57.727166 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f04810-94de-4ec3-9acc-01829d6d0e74 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:57.727166 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f04810-94de-4ec3-9acc-01829d6d0e74 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:57.727455 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f04810-94de-4ec3-9acc-01829d6d0e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:57.748546 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-44f04810-94de-4ec3-9acc-01829d6d0e74 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:57.749733 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-44f04810-94de-4ec3-9acc-01829d6d0e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:57.806039 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e06771-312c-4e42-a29a-87e1b97e4506 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:57.834888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 138/283] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:50:57.836051 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f04810-94de-4ec3-9acc-01829d6d0e74 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:57.844659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a6f3c-363f-4282-b648-d823c9f8877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:57.845591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6f3c-363f-4282-b648-d823c9f8877b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:57.846087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6f3c-363f-4282-b648-d823c9f8877b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:57.846557 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6f3c-363f-4282-b648-d823c9f8877b None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:57.847495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a6f3c-363f-4282-b648-d823c9f8877b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:57.848584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a6f3c-363f-4282-b648-d823c9f8877b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:57.850599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a6f3c-363f-4282-b648-d823c9f8877b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:57.854745 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:57.858874 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:57.862998 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 146/284] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:57.864332 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a6f3c-363f-4282-b648-d823c9f8877b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:57.981578 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f04810-94de-4ec3-9acc-01829d6d0e74 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:57.989295 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a6f3c-363f-4282-b648-d823c9f8877b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.025931 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713dd02-30e6-4c2a-a8f4-d2770f26927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.026759 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713dd02-30e6-4c2a-a8f4-d2770f26927b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.027042 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713dd02-30e6-4c2a-a8f4-d2770f26927b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.027317 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713dd02-30e6-4c2a-a8f4-d2770f26927b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.027916 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde5f04-331c-4cf0-a423-edb00ff8c516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.028573 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde5f04-331c-4cf0-a423-edb00ff8c516 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.028857 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde5f04-331c-4cf0-a423-edb00ff8c516 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.029412 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde5f04-331c-4cf0-a423-edb00ff8c516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.030667 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde5f04-331c-4cf0-a423-edb00ff8c516 None admin] RBAC: Adding query filter params (role.id=997ba13b80634887b0a7e88cbf2b2e62, user.id=0221f0f281a0420084d49b5049b4c0dd, scope.system=all) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:58.030983 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde5f04-331c-4cf0-a423-edb00ff8c516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.033042 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde5f04-331c-4cf0-a423-edb00ff8c516 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:58.039783 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 139/285] 10.222.0.43 () {56 vars in 1308 bytes} [Wed May 25 13:50:57 2022] GET /identity/v3/role_assignments?user.id=0221f0f281a0420084d49b5049b4c0dd&scope.system=all&role.id=997ba13b80634887b0a7e88cbf2b2e62 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:58.040755 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde5f04-331c-4cf0-a423-edb00ff8c516 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:58.040863 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713dd02-30e6-4c2a-a8f4-d2770f26927b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-1713dd02-30e6-4c2a-a8f4-d2770f26927b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:50:58.052026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:50:58.052994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:50:58.053781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:50:58.053781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:50:58.053781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:50:58.053781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:50:58.053781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:50:58.053781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:50:58.053781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:50:58.053781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:50:58.053781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:50:58.053781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:50:58.053781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:50:58.053781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:50:58.054375 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 147/286] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:50:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:50:58.060163 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713dd02-30e6-4c2a-a8f4-d2770f26927b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:58.200442 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:58.221945 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:58.236346 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde5f04-331c-4cf0-a423-edb00ff8c516 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.288354 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713dd02-30e6-4c2a-a8f4-d2770f26927b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.297144 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ee7c2-7542-4def-9cea-46cb1e2159ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.298038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ee7c2-7542-4def-9cea-46cb1e2159ba None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.298320 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ee7c2-7542-4def-9cea-46cb1e2159ba None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.298594 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ee7c2-7542-4def-9cea-46cb1e2159ba None admin] PATH_INFO: `/v3/users/9bbff3d3d2a144e98a99002551f4bbe8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.299900 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ee7c2-7542-4def-9cea-46cb1e2159ba None admin] RBAC: Authorizing `identity:get_user(user_id=9bbff3d3d2a144e98a99002551f4bbe8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.301361 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ee7c2-7542-4def-9cea-46cb1e2159ba None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:58.303618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 140/287] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:58 2022] GET /identity/v3/users/9bbff3d3d2a144e98a99002551f4bbe8 => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:58.310166 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ee7c2-7542-4def-9cea-46cb1e2159ba None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:58.350187 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7696a-fab9-4305-8a3e-302ea4b5ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.350867 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7696a-fab9-4305-8a3e-302ea4b5ac88 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.351152 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7696a-fab9-4305-8a3e-302ea4b5ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.351429 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7696a-fab9-4305-8a3e-302ea4b5ac88 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.352211 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7696a-fab9-4305-8a3e-302ea4b5ac88 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:58.352521 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7696a-fab9-4305-8a3e-302ea4b5ac88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.353917 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7696a-fab9-4305-8a3e-302ea4b5ac88 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:58.374206 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 148/288] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:50:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:58.379526 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7696a-fab9-4305-8a3e-302ea4b5ac88 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:58.437289 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ee7c2-7542-4def-9cea-46cb1e2159ba None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.479825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14422ddd-ef76-416d-b3b0-67c20f8a3a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.479825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422ddd-ef76-416d-b3b0-67c20f8a3a88 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.479825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422ddd-ef76-416d-b3b0-67c20f8a3a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.479825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422ddd-ef76-416d-b3b0-67c20f8a3a88 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.480197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14422ddd-ef76-416d-b3b0-67c20f8a3a88 None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.480197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14422ddd-ef76-416d-b3b0-67c20f8a3a88 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:58.481163 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 141/289] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:58 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:50:58.487204 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14422ddd-ef76-416d-b3b0-67c20f8a3a88 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:58.520078 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:58.593408 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7696a-fab9-4305-8a3e-302ea4b5ac88 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.636813 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:58.654260 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbf5b8-23c2-44d5-b17c-d04349cdc746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.655661 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbf5b8-23c2-44d5-b17c-d04349cdc746 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.655986 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbf5b8-23c2-44d5-b17c-d04349cdc746 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.656262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbf5b8-23c2-44d5-b17c-d04349cdc746 None admin] PATH_INFO: `/v3/users/3a432c4549234237816b7680cea25d67` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.657528 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbf5b8-23c2-44d5-b17c-d04349cdc746 None admin] RBAC: Authorizing `identity:get_user(user_id=3a432c4549234237816b7680cea25d67)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.659168 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbf5b8-23c2-44d5-b17c-d04349cdc746 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:58.661264 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 149/290] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:50:58 2022] GET /identity/v3/users/3a432c4549234237816b7680cea25d67 => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:58.666710 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbf5b8-23c2-44d5-b17c-d04349cdc746 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:58.686879 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14422ddd-ef76-416d-b3b0-67c20f8a3a88 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.765114 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8c3ee-893f-4547-9f9d-81655cce5015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.765931 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8c3ee-893f-4547-9f9d-81655cce5015 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.766212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8c3ee-893f-4547-9f9d-81655cce5015 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.766488 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8c3ee-893f-4547-9f9d-81655cce5015 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9/users/9bbff3d3d2a144e98a99002551f4bbe8/roles/36d58da2a9494447b686349f4426d7d7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.773074 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8c3ee-893f-4547-9f9d-81655cce5015 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c0322c32dc4d1b8292e7736aea59b9, user_id=9bbff3d3d2a144e98a99002551f4bbe8, role_id=36d58da2a9494447b686349f4426d7d7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.774541 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8c3ee-893f-4547-9f9d-81655cce5015 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:58.811863 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbf5b8-23c2-44d5-b17c-d04349cdc746 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.853245 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1efad2-ad62-42b2-8dbd-4a13e930d2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.853902 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1efad2-ad62-42b2-8dbd-4a13e930d2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.854186 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1efad2-ad62-42b2-8dbd-4a13e930d2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.854482 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1efad2-ad62-42b2-8dbd-4a13e930d2d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.871952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 142/291] 10.222.0.43 () {58 vars in 1439 bytes} [Wed May 25 13:50:58 2022] PUT /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9/users/9bbff3d3d2a144e98a99002551f4bbe8/roles/36d58da2a9494447b686349f4426d7d7 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:58.936757 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:58.956248 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1efad2-ad62-42b2-8dbd-4a13e930d2d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.958414 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1efad2-ad62-42b2-8dbd-4a13e930d2d6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:59.091807 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 150/292] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:50:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:50:59.100896 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8c3ee-893f-4547-9f9d-81655cce5015 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:59.184518 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:59.219866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8c3ee-893f-4547-9f9d-81655cce5015 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:59.270778 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7705de-5fb6-475d-929b-82e6660c69e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:59.271629 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7705de-5fb6-475d-929b-82e6660c69e3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:59.271966 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7705de-5fb6-475d-929b-82e6660c69e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:59.272244 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7705de-5fb6-475d-929b-82e6660c69e3 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:59.277099 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7705de-5fb6-475d-929b-82e6660c69e3 None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:59.279267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7705de-5fb6-475d-929b-82e6660c69e3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:59.281377 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 143/293] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:50:59 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:59.287745 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1efad2-ad62-42b2-8dbd-4a13e930d2d6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:59.428192 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:59.448764 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1efad2-ad62-42b2-8dbd-4a13e930d2d6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:59.501812 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d3664-b55f-4e9d-8c79-bec20286b8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:59.502823 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d3664-b55f-4e9d-8c79-bec20286b8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:59.503308 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d3664-b55f-4e9d-8c79-bec20286b8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:59.503833 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d3664-b55f-4e9d-8c79-bec20286b8e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:59.505385 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d3664-b55f-4e9d-8c79-bec20286b8e6 None admin] RBAC: Adding query filter params (role.id=997ba13b80634887b0a7e88cbf2b2e62, scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9, user.id=3a432c4549234237816b7680cea25d67) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:59.505898 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d3664-b55f-4e9d-8c79-bec20286b8e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:59.507567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d3664-b55f-4e9d-8c79-bec20286b8e6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:59.521308 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 151/294] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:50:59 2022] GET /identity/v3/role_assignments?user.id=3a432c4549234237816b7680cea25d67&scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9&role.id=997ba13b80634887b0a7e88cbf2b2e62 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:00.178205 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f46b9f-20e6-47ed-b330-388b5c9d1e87 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.178710 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f46b9f-20e6-47ed-b330-388b5c9d1e87 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.178783 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f46b9f-20e6-47ed-b330-388b5c9d1e87 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.180450 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 144/295] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:00.186185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5e2b0-a3d9-4fd1-a69c-09525ce6ffc1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.186738 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5e2b0-a3d9-4fd1-a69c-09525ce6ffc1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.187217 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5e2b0-a3d9-4fd1-a69c-09525ce6ffc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.207965 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5aa5e2b0-a3d9-4fd1-a69c-09525ce6ffc1 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:00.209214 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5aa5e2b0-a3d9-4fd1-a69c-09525ce6ffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:00.270399 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b70079-5dc6-41b6-8233-2e0d6613bdff None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.271523 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b70079-5dc6-41b6-8233-2e0d6613bdff None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.272042 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b70079-5dc6-41b6-8233-2e0d6613bdff None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.273621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 145/296] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:00.279265 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdac279-c0f0-4436-b0a1-9a87ee46a43f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.279880 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdac279-c0f0-4436-b0a1-9a87ee46a43f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.280388 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdac279-c0f0-4436-b0a1-9a87ee46a43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.296192 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 152/297] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:00.300103 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bbdac279-c0f0-4436-b0a1-9a87ee46a43f None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:00.301575 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bbdac279-c0f0-4436-b0a1-9a87ee46a43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:00.314236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5e2b0-a3d9-4fd1-a69c-09525ce6ffc1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:00.381874 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 146/298] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:00.405462 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdac279-c0f0-4436-b0a1-9a87ee46a43f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:00.412690 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:00.439490 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5e2b0-a3d9-4fd1-a69c-09525ce6ffc1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:00.479078 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6df73e-cd4a-44f9-bd97-65a081baea0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:00.479989 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6df73e-cd4a-44f9-bd97-65a081baea0b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.480275 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6df73e-cd4a-44f9-bd97-65a081baea0b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.480550 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6df73e-cd4a-44f9-bd97-65a081baea0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.481757 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6df73e-cd4a-44f9-bd97-65a081baea0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:00.483348 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6df73e-cd4a-44f9-bd97-65a081baea0b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:00.485482 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 153/299] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:00.487866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:00.491770 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6df73e-cd4a-44f9-bd97-65a081baea0b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:00.525505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdac279-c0f0-4436-b0a1-9a87ee46a43f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:00.564735 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606d3a0-3879-4ac6-b1bf-28044cceb422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:00.565584 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606d3a0-3879-4ac6-b1bf-28044cceb422 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.565866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606d3a0-3879-4ac6-b1bf-28044cceb422 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.566200 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606d3a0-3879-4ac6-b1bf-28044cceb422 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.578347 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606d3a0-3879-4ac6-b1bf-28044cceb422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4606d3a0-3879-4ac6-b1bf-28044cceb422 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:00.587579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:00.588533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:00.589325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:00.589325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:00.589325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:00.589325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:00.589325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:00.589325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:00.589325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:00.589325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:00.589325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:00.589325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:00.589325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:51:00.589325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:00.589325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 147/300] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:00.596800 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606d3a0-3879-4ac6-b1bf-28044cceb422 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:00.627750 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6df73e-cd4a-44f9-bd97-65a081baea0b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:00.667609 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5c9c6-56a9-4090-9f6c-414cd7f570e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:00.668308 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5c9c6-56a9-4090-9f6c-414cd7f570e7 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.668592 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5c9c6-56a9-4090-9f6c-414cd7f570e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.668870 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5c9c6-56a9-4090-9f6c-414cd7f570e7 None admin] PATH_INFO: `/v3/groups` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.669638 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5c9c6-56a9-4090-9f6c-414cd7f570e7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:00.671098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5c9c6-56a9-4090-9f6c-414cd7f570e7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:00.717765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606d3a0-3879-4ac6-b1bf-28044cceb422 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:00.744076 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 154/301] 10.222.0.43 () {60 vars in 1134 bytes} [Wed May 25 13:51:00 2022] POST /identity/v3/groups => generated 229 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:51:00.746042 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354779d2-8035-4a7b-ac17-75dc5af9ffc3 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.746340 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354779d2-8035-4a7b-ac17-75dc5af9ffc3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.746620 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354779d2-8035-4a7b-ac17-75dc5af9ffc3 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.751891 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 155/302] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:00.753918 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:00.755662 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46abc41-d083-47aa-9d56-31379c7d6576 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.755978 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46abc41-d083-47aa-9d56-31379c7d6576 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.756257 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46abc41-d083-47aa-9d56-31379c7d6576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.766905 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27445a-eea3-49ad-97a3-4a5222805b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:00.767603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27445a-eea3-49ad-97a3-4a5222805b01 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.767937 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27445a-eea3-49ad-97a3-4a5222805b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.768216 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27445a-eea3-49ad-97a3-4a5222805b01 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.768993 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27445a-eea3-49ad-97a3-4a5222805b01 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:00.769305 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27445a-eea3-49ad-97a3-4a5222805b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:00.771347 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27445a-eea3-49ad-97a3-4a5222805b01 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:00.787457 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 148/303] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:51:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:00.788500 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27445a-eea3-49ad-97a3-4a5222805b01 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:00.788609 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a46abc41-d083-47aa-9d56-31379c7d6576 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:00.790280 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a46abc41-d083-47aa-9d56-31379c7d6576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:00.795356 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:00.896273 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 156/304] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:51:00.913879 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27445a-eea3-49ad-97a3-4a5222805b01 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:00.925138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46abc41-d083-47aa-9d56-31379c7d6576 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:00.961787 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd087c16-ea4a-4780-aecb-afe21fc1130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:00.962743 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd087c16-ea4a-4780-aecb-afe21fc1130b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.963034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd087c16-ea4a-4780-aecb-afe21fc1130b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.963316 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd087c16-ea4a-4780-aecb-afe21fc1130b None admin] PATH_INFO: `/v3/users/60964ac7f9c5490c9df6eea3ecd09e0d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.978691 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd087c16-ea4a-4780-aecb-afe21fc1130b None admin] RBAC: Authorizing `identity:get_user(user_id=60964ac7f9c5490c9df6eea3ecd09e0d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:00.980132 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd087c16-ea4a-4780-aecb-afe21fc1130b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:00.981988 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 149/305] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:51:00 2022] GET /identity/v3/users/60964ac7f9c5490c9df6eea3ecd09e0d => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:00.987568 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd087c16-ea4a-4780-aecb-afe21fc1130b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.054922 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:01.055219 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46abc41-d083-47aa-9d56-31379c7d6576 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.101126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b5c87-065c-4743-aa74-2834d5655f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.101926 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5c87-065c-4743-aa74-2834d5655f82 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.102209 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5c87-065c-4743-aa74-2834d5655f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.102484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5c87-065c-4743-aa74-2834d5655f82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.115078 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:01.120558 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b5c87-065c-4743-aa74-2834d5655f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:01.123073 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd087c16-ea4a-4780-aecb-afe21fc1130b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-fd9b5c87-065c-4743-aa74-2834d5655f82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:01.131262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:01.139259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:01.140299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:01.140299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:01.140299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:01.140299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:01.140299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:01.140299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:01.140299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:01.140299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:01.140299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:01.140299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:01.140299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:01.140299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:01.140299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 157/306] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:01.140299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b5c87-065c-4743-aa74-2834d5655f82 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.168576 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d2d8b-8278-495d-af26-c9eb3a683a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.169520 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d2d8b-8278-495d-af26-c9eb3a683a38 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.169818 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d2d8b-8278-495d-af26-c9eb3a683a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.170099 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d2d8b-8278-495d-af26-c9eb3a683a38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.171231 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d2d8b-8278-495d-af26-c9eb3a683a38 None admin] RBAC: Adding query filter params (role.id=36d58da2a9494447b686349f4426d7d7, user.id=60964ac7f9c5490c9df6eea3ecd09e0d, scope.system=all) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:01.172001 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d2d8b-8278-495d-af26-c9eb3a683a38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:01.173981 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d2d8b-8278-495d-af26-c9eb3a683a38 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.186370 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 150/307] 10.222.0.43 () {56 vars in 1308 bytes} [Wed May 25 13:51:00 2022] GET /identity/v3/role_assignments?user.id=60964ac7f9c5490c9df6eea3ecd09e0d&scope.system=all&role.id=36d58da2a9494447b686349f4426d7d7 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:01.271815 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b5c87-065c-4743-aa74-2834d5655f82 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.339348 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f33f3-18da-466a-9ea2-039fd569fd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.340657 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f33f3-18da-466a-9ea2-039fd569fd85 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.341085 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f33f3-18da-466a-9ea2-039fd569fd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.341505 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f33f3-18da-466a-9ea2-039fd569fd85 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.342754 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f33f3-18da-466a-9ea2-039fd569fd85 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:01.343213 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f33f3-18da-466a-9ea2-039fd569fd85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:01.345635 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f33f3-18da-466a-9ea2-039fd569fd85 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.361011 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 158/308] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:51:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:01.368031 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d2d8b-8278-495d-af26-c9eb3a683a38 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.476156 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d2d8b-8278-495d-af26-c9eb3a683a38 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.492190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:01.511578 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa2c1a-8a33-4e35-b290-3205dda43b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.512482 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa2c1a-8a33-4e35-b290-3205dda43b50 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.512765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa2c1a-8a33-4e35-b290-3205dda43b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.513041 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa2c1a-8a33-4e35-b290-3205dda43b50 None admin] PATH_INFO: `/v3/users/0221f0f281a0420084d49b5049b4c0dd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.514245 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa2c1a-8a33-4e35-b290-3205dda43b50 None admin] RBAC: Authorizing `identity:get_user(user_id=0221f0f281a0420084d49b5049b4c0dd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:01.515699 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa2c1a-8a33-4e35-b290-3205dda43b50 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.517654 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 151/309] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:51:01 2022] GET /identity/v3/users/0221f0f281a0420084d49b5049b4c0dd => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:01.524035 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f33f3-18da-466a-9ea2-039fd569fd85 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.540606 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebbf81-6ee2-459f-bf23-7a4b1d5810f6 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.540919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebbf81-6ee2-459f-bf23-7a4b1d5810f6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.541633 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebbf81-6ee2-459f-bf23-7a4b1d5810f6 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.543442 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 152/310] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:51:01.549884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f41c9-973a-4660-b9b7-e40bc388b8db None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.550465 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f41c9-973a-4660-b9b7-e40bc388b8db None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.550751 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f41c9-973a-4660-b9b7-e40bc388b8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.573742 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-534f41c9-973a-4660-b9b7-e40bc388b8db None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:01.574928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-534f41c9-973a-4660-b9b7-e40bc388b8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:01.596245 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:01.646813 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f33f3-18da-466a-9ea2-039fd569fd85 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.647200 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 153/311] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:51:01.670717 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f41c9-973a-4660-b9b7-e40bc388b8db None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.694003 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56214928-c06c-45ff-a5e0-ef010f09347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.694882 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56214928-c06c-45ff-a5e0-ef010f09347e None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.695160 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56214928-c06c-45ff-a5e0-ef010f09347e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.695432 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56214928-c06c-45ff-a5e0-ef010f09347e None admin] PATH_INFO: `/v3/system/users/0221f0f281a0420084d49b5049b4c0dd/roles/997ba13b80634887b0a7e88cbf2b2e62` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.696960 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56214928-c06c-45ff-a5e0-ef010f09347e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0221f0f281a0420084d49b5049b4c0dd, role_id=997ba13b80634887b0a7e88cbf2b2e62)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:01.698361 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56214928-c06c-45ff-a5e0-ef010f09347e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.780559 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f41c9-973a-4660-b9b7-e40bc388b8db None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.784064 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 159/312] 10.222.0.43 () {58 vars in 1334 bytes} [Wed May 25 13:51:01 2022] PUT /identity/v3/system/users/0221f0f281a0420084d49b5049b4c0dd/roles/997ba13b80634887b0a7e88cbf2b2e62 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:01.803900 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:01.828233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8525a-aedd-4ae4-b497-d26611f4ae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.829099 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8525a-aedd-4ae4-b497-d26611f4ae23 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.829392 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8525a-aedd-4ae4-b497-d26611f4ae23 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.829672 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8525a-aedd-4ae4-b497-d26611f4ae23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.844269 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8525a-aedd-4ae4-b497-d26611f4ae23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-42c8525a-aedd-4ae4-b497-d26611f4ae23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:01.853692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:01.854660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:01.855449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:01.855449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:01.855449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:01.855449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:01.855449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:01.855449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:01.855449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:01.855449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:01.855449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:01.855449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:01.855449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:51:01.855449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:01.855449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 154/313] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:01.863049 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56214928-c06c-45ff-a5e0-ef010f09347e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.981683 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56214928-c06c-45ff-a5e0-ef010f09347e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:02.014366 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:02.028098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616087fb-2620-4a9d-bd97-79152b3c9807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:02.033310 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616087fb-2620-4a9d-bd97-79152b3c9807 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:02.033310 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616087fb-2620-4a9d-bd97-79152b3c9807 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:02.033310 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616087fb-2620-4a9d-bd97-79152b3c9807 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:02.033310 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616087fb-2620-4a9d-bd97-79152b3c9807 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:02.033310 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616087fb-2620-4a9d-bd97-79152b3c9807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:02.033310 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616087fb-2620-4a9d-bd97-79152b3c9807 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:02.043345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 160/314] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:51:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:02.048907 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8525a-aedd-4ae4-b497-d26611f4ae23 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:02.162620 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8525a-aedd-4ae4-b497-d26611f4ae23 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:02.199784 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64c4a3-1118-4a62-8c1f-11fdf7f11865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:02.200674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64c4a3-1118-4a62-8c1f-11fdf7f11865 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:02.200962 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64c4a3-1118-4a62-8c1f-11fdf7f11865 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:02.201247 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64c4a3-1118-4a62-8c1f-11fdf7f11865 None admin] PATH_INFO: `/v3/users/9bbff3d3d2a144e98a99002551f4bbe8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:02.202466 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64c4a3-1118-4a62-8c1f-11fdf7f11865 None admin] RBAC: Authorizing `identity:get_user(user_id=9bbff3d3d2a144e98a99002551f4bbe8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:02.203984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64c4a3-1118-4a62-8c1f-11fdf7f11865 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:02.205985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 155/315] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:51:02 2022] GET /identity/v3/users/9bbff3d3d2a144e98a99002551f4bbe8 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:02.211172 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616087fb-2620-4a9d-bd97-79152b3c9807 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:02.323965 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616087fb-2620-4a9d-bd97-79152b3c9807 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:02.366628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e526b1d-bb04-4928-b946-5389d32aa746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:02.367348 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e526b1d-bb04-4928-b946-5389d32aa746 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:02.367638 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e526b1d-bb04-4928-b946-5389d32aa746 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:02.367945 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e526b1d-bb04-4928-b946-5389d32aa746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:02.428175 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:02.438431 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e526b1d-bb04-4928-b946-5389d32aa746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:02.439943 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e526b1d-bb04-4928-b946-5389d32aa746 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:02.549709 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 161/316] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:02.557590 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64c4a3-1118-4a62-8c1f-11fdf7f11865 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:02.608200 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:02.666965 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64c4a3-1118-4a62-8c1f-11fdf7f11865 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:02.703452 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a36534-a134-42c4-be92-4ee65e5c5306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:02.704351 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36534-a134-42c4-be92-4ee65e5c5306 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:02.704638 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36534-a134-42c4-be92-4ee65e5c5306 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:02.704920 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36534-a134-42c4-be92-4ee65e5c5306 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:02.706119 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a36534-a134-42c4-be92-4ee65e5c5306 None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:02.708113 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a36534-a134-42c4-be92-4ee65e5c5306 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:02.710771 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 156/317] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:02 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:02.716550 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e526b1d-bb04-4928-b946-5389d32aa746 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:02.816237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:02.819080 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e526b1d-bb04-4928-b946-5389d32aa746 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:02.853351 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e52919-f7a1-4deb-b128-1a36b9fe6536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:02.854007 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e52919-f7a1-4deb-b128-1a36b9fe6536 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:02.854292 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e52919-f7a1-4deb-b128-1a36b9fe6536 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:02.854568 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e52919-f7a1-4deb-b128-1a36b9fe6536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:02.855395 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e52919-f7a1-4deb-b128-1a36b9fe6536 None admin] RBAC: Adding query filter params (role.id=36d58da2a9494447b686349f4426d7d7, scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9, user.id=9bbff3d3d2a144e98a99002551f4bbe8) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:02.855706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e52919-f7a1-4deb-b128-1a36b9fe6536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:02.857214 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e52919-f7a1-4deb-b128-1a36b9fe6536 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:02.868081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 162/318] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:51:02 2022] GET /identity/v3/role_assignments?user.id=9bbff3d3d2a144e98a99002551f4bbe8&scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9&role.id=36d58da2a9494447b686349f4426d7d7 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:03.185078 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7795189-17eb-4953-9956-f8cb07c7ddfa None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:03.185727 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7795189-17eb-4953-9956-f8cb07c7ddfa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:03.186219 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7795189-17eb-4953-9956-f8cb07c7ddfa None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:03.187829 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 157/319] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:03.193360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50444db-317e-4fe5-a509-2a4cf53909bf None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:03.193869 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50444db-317e-4fe5-a509-2a4cf53909bf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:03.194351 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50444db-317e-4fe5-a509-2a4cf53909bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:03.211584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a50444db-317e-4fe5-a509-2a4cf53909bf None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:03.213030 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a50444db-317e-4fe5-a509-2a4cf53909bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:03.288794 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 163/320] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:03.312290 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7795189-17eb-4953-9956-f8cb07c7ddfa None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:03.422097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7795189-17eb-4953-9956-f8cb07c7ddfa None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:03.431763 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:03.456626 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916971fd-11a4-4e15-b6da-ca4945824778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:03.457405 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916971fd-11a4-4e15-b6da-ca4945824778 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:03.457843 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916971fd-11a4-4e15-b6da-ca4945824778 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:03.458341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916971fd-11a4-4e15-b6da-ca4945824778 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:03.459366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916971fd-11a4-4e15-b6da-ca4945824778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:03.460856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916971fd-11a4-4e15-b6da-ca4945824778 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:03.462730 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 158/321] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:03.468320 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50444db-317e-4fe5-a509-2a4cf53909bf None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:03.515744 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec9f3-5f38-469a-98f3-8210d116cdb2 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:03.516067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec9f3-5f38-469a-98f3-8210d116cdb2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:03.516332 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec9f3-5f38-469a-98f3-8210d116cdb2 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:03.517731 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 159/322] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:03.522973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72e81-b9c5-44f0-97a8-aeb9b631c57e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:03.523263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72e81-b9c5-44f0-97a8-aeb9b631c57e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:03.523542 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72e81-b9c5-44f0-97a8-aeb9b631c57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:03.542164 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-54b72e81-b9c5-44f0-97a8-aeb9b631c57e None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:03.543345 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-54b72e81-b9c5-44f0-97a8-aeb9b631c57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:03.556155 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:03.578584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50444db-317e-4fe5-a509-2a4cf53909bf None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:03.616058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a200082-2096-4b74-85f2-844328930cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:03.616448 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 160/323] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:51:03.616996 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a200082-2096-4b74-85f2-844328930cfd None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:03.617276 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a200082-2096-4b74-85f2-844328930cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:03.617575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a200082-2096-4b74-85f2-844328930cfd None admin] PATH_INFO: `/v3/groups` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:03.618265 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a200082-2096-4b74-85f2-844328930cfd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:03.619785 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a200082-2096-4b74-85f2-844328930cfd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:03.638946 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b72e81-b9c5-44f0-97a8-aeb9b631c57e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:03.733291 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 164/324] 10.222.0.43 () {60 vars in 1134 bytes} [Wed May 25 13:51:03 2022] POST /identity/v3/groups => generated 226 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:03.743899 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b72e81-b9c5-44f0-97a8-aeb9b631c57e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:03.752903 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:03.785047 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574f415-4947-4b58-a9e6-61f6c5b8820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:03.786440 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574f415-4947-4b58-a9e6-61f6c5b8820e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:03.786727 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574f415-4947-4b58-a9e6-61f6c5b8820e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:03.787002 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574f415-4947-4b58-a9e6-61f6c5b8820e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:03.799256 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574f415-4947-4b58-a9e6-61f6c5b8820e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f574f415-4947-4b58-a9e6-61f6c5b8820e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:03.809046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:03.810032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:03.811020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:03.811020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:03.811020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:03.811020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:03.811020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:03.811020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:03.811020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:03.811020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:03.811020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:03.811020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:03.811020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:51:03.811020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:03.811020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 161/325] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:03.816144 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a200082-2096-4b74-85f2-844328930cfd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:03.928306 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a200082-2096-4b74-85f2-844328930cfd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:03.968884 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c661ed6-2066-45c6-b83d-e2f5f8e5e959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:03.969553 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661ed6-2066-45c6-b83d-e2f5f8e5e959 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:03.969837 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661ed6-2066-45c6-b83d-e2f5f8e5e959 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:03.970109 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661ed6-2066-45c6-b83d-e2f5f8e5e959 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:03.970857 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c661ed6-2066-45c6-b83d-e2f5f8e5e959 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:03.971161 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c661ed6-2066-45c6-b83d-e2f5f8e5e959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:03.972581 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c661ed6-2066-45c6-b83d-e2f5f8e5e959 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:03.981341 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 165/326] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:51:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:03.986819 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574f415-4947-4b58-a9e6-61f6c5b8820e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:04.100638 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874096d7-d928-45ff-b2c9-b061c88f5b77 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.100977 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874096d7-d928-45ff-b2c9-b061c88f5b77 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.101198 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874096d7-d928-45ff-b2c9-b061c88f5b77 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.102145 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574f415-4947-4b58-a9e6-61f6c5b8820e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:04.102557 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 166/327] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:04.108982 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1ab5b-8884-47fc-9df5-a4b493def85f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.109256 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1ab5b-8884-47fc-9df5-a4b493def85f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.109532 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1ab5b-8884-47fc-9df5-a4b493def85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.119598 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:04.133092 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-51c1ab5b-8884-47fc-9df5-a4b493def85f None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:04.134393 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-51c1ab5b-8884-47fc-9df5-a4b493def85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:04.144397 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7155705-43cb-4d62-b557-71a1a56f35c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:04.146133 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7155705-43cb-4d62-b557-71a1a56f35c5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.146922 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7155705-43cb-4d62-b557-71a1a56f35c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.147206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7155705-43cb-4d62-b557-71a1a56f35c5 None admin] PATH_INFO: `/v3/users/60964ac7f9c5490c9df6eea3ecd09e0d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.148678 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7155705-43cb-4d62-b557-71a1a56f35c5 None admin] RBAC: Authorizing `identity:get_user(user_id=60964ac7f9c5490c9df6eea3ecd09e0d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:04.150285 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7155705-43cb-4d62-b557-71a1a56f35c5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:04.151848 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 162/328] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:51:03 2022] GET /identity/v3/users/60964ac7f9c5490c9df6eea3ecd09e0d => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:04.158365 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7155705-43cb-4d62-b557-71a1a56f35c5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:04.201133 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:04.218138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 167/329] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:04.243161 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1ab5b-8884-47fc-9df5-a4b493def85f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:04.289326 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7155705-43cb-4d62-b557-71a1a56f35c5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:04.345260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba33d2f-9404-42bc-8cc7-6862d9c44ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:04.346184 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33d2f-9404-42bc-8cc7-6862d9c44ec5 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.346485 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33d2f-9404-42bc-8cc7-6862d9c44ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.346762 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33d2f-9404-42bc-8cc7-6862d9c44ec5 None admin] PATH_INFO: `/v3/system/users/60964ac7f9c5490c9df6eea3ecd09e0d/roles/36d58da2a9494447b686349f4426d7d7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.352225 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba33d2f-9404-42bc-8cc7-6862d9c44ec5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=60964ac7f9c5490c9df6eea3ecd09e0d, role_id=36d58da2a9494447b686349f4426d7d7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:04.353629 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba33d2f-9404-42bc-8cc7-6862d9c44ec5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:04.392851 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1ab5b-8884-47fc-9df5-a4b493def85f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:04.419445 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 163/330] 10.222.0.43 () {58 vars in 1334 bytes} [Wed May 25 13:51:04 2022] PUT /identity/v3/system/users/60964ac7f9c5490c9df6eea3ecd09e0d/roles/36d58da2a9494447b686349f4426d7d7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:04.435907 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec203e-c63f-4afc-9b08-13fbcc0bfe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:04.436784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec203e-c63f-4afc-9b08-13fbcc0bfe23 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.437071 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec203e-c63f-4afc-9b08-13fbcc0bfe23 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.437348 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec203e-c63f-4afc-9b08-13fbcc0bfe23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.439634 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:04.451056 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec203e-c63f-4afc-9b08-13fbcc0bfe23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-2eec203e-c63f-4afc-9b08-13fbcc0bfe23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:04.460504 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:04.463651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:04.464713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:04.464713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:04.464713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:04.464713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:04.464713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:04.464713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:04.464713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:04.464713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:04.464713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:04.464713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:04.464713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:04.464713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:04.464713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 168/331] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:04.467788 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba33d2f-9404-42bc-8cc7-6862d9c44ec5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:04.591509 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:04.596753 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba33d2f-9404-42bc-8cc7-6862d9c44ec5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:04.635837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1f49d-ac98-4511-abfe-f16cf5190c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:04.636523 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1f49d-ac98-4511-abfe-f16cf5190c54 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.636804 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1f49d-ac98-4511-abfe-f16cf5190c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.637080 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1f49d-ac98-4511-abfe-f16cf5190c54 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.637902 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1f49d-ac98-4511-abfe-f16cf5190c54 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:04.638212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1f49d-ac98-4511-abfe-f16cf5190c54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:04.639616 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1f49d-ac98-4511-abfe-f16cf5190c54 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:04.650372 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 164/332] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:51:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:04.655564 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec203e-c63f-4afc-9b08-13fbcc0bfe23 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:04.761901 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec203e-c63f-4afc-9b08-13fbcc0bfe23 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:04.797480 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d75cd-c880-4265-b0a4-78f592619497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:04.798360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d75cd-c880-4265-b0a4-78f592619497 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.798642 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d75cd-c880-4265-b0a4-78f592619497 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.798916 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d75cd-c880-4265-b0a4-78f592619497 None admin] PATH_INFO: `/v3/users/0221f0f281a0420084d49b5049b4c0dd` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.800132 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d75cd-c880-4265-b0a4-78f592619497 None admin] RBAC: Authorizing `identity:get_user(user_id=0221f0f281a0420084d49b5049b4c0dd)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:04.802257 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d75cd-c880-4265-b0a4-78f592619497 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:04.804430 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 169/333] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:51:04 2022] GET /identity/v3/users/0221f0f281a0420084d49b5049b4c0dd => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:04.809672 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1f49d-ac98-4511-abfe-f16cf5190c54 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:04.915767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1f49d-ac98-4511-abfe-f16cf5190c54 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:04.950491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a595dad-d65c-441d-8baa-e7d4a81c65f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:04.951146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a595dad-d65c-441d-8baa-e7d4a81c65f6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.951428 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a595dad-d65c-441d-8baa-e7d4a81c65f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.951702 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a595dad-d65c-441d-8baa-e7d4a81c65f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.952561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a595dad-d65c-441d-8baa-e7d4a81c65f6 None admin] RBAC: Adding query filter params (role.id=997ba13b80634887b0a7e88cbf2b2e62, user.id=0221f0f281a0420084d49b5049b4c0dd, scope.system=all) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:04.952869 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a595dad-d65c-441d-8baa-e7d4a81c65f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:04.954312 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a595dad-d65c-441d-8baa-e7d4a81c65f6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:04.968292 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 165/334] 10.222.0.43 () {56 vars in 1308 bytes} [Wed May 25 13:51:04 2022] GET /identity/v3/role_assignments?user.id=0221f0f281a0420084d49b5049b4c0dd&scope.system=all&role.id=997ba13b80634887b0a7e88cbf2b2e62 => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:06.735145 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69584c-34e2-4921-8cf1-dbb0b7b36237 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:06.735912 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69584c-34e2-4921-8cf1-dbb0b7b36237 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:06.735912 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69584c-34e2-4921-8cf1-dbb0b7b36237 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:06.737322 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 170/335] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:06.743630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7966c08-d70b-45a3-8cfe-0823c816943b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:06.744211 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7966c08-d70b-45a3-8cfe-0823c816943b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:06.744385 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7966c08-d70b-45a3-8cfe-0823c816943b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:06.763438 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f7966c08-d70b-45a3-8cfe-0823c816943b None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:06.764664 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f7966c08-d70b-45a3-8cfe-0823c816943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:06.779459 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:06.837397 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d924a3e-b16d-48ac-b5d5-05ddf42118af None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:06.837737 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d924a3e-b16d-48ac-b5d5-05ddf42118af None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:06.837955 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d924a3e-b16d-48ac-b5d5-05ddf42118af None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:06.839308 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 171/336] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:51:06.845201 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d02f62-98d8-421f-9e6b-1e3742c9e924 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:06.845485 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d02f62-98d8-421f-9e6b-1e3742c9e924 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:06.845762 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d02f62-98d8-421f-9e6b-1e3742c9e924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:06.865971 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 166/337] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:06.874493 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-91d02f62-98d8-421f-9e6b-1e3742c9e924 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:06.875666 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-91d02f62-98d8-421f-9e6b-1e3742c9e924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:06.947506 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:06.961703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 172/338] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:06.978036 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7966c08-d70b-45a3-8cfe-0823c816943b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:07.001953 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d02f62-98d8-421f-9e6b-1e3742c9e924 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:07.181487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7966c08-d70b-45a3-8cfe-0823c816943b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:07.202749 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d02f62-98d8-421f-9e6b-1e3742c9e924 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:07.249408 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040aaac-d30d-4960-9d41-503746ebd2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:07.250609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040aaac-d30d-4960-9d41-503746ebd2ba None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.251103 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040aaac-d30d-4960-9d41-503746ebd2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.251284 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234f5ec-0b89-4101-b4aa-13cdc95c4a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:07.251791 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040aaac-d30d-4960-9d41-503746ebd2ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:07.252168 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234f5ec-0b89-4101-b4aa-13cdc95c4a05 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.252407 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234f5ec-0b89-4101-b4aa-13cdc95c4a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.252688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234f5ec-0b89-4101-b4aa-13cdc95c4a05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:07.268803 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234f5ec-0b89-4101-b4aa-13cdc95c4a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:07.273511 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040aaac-d30d-4960-9d41-503746ebd2ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3234f5ec-0b89-4101-b4aa-13cdc95c4a05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:07.277719 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:07.278639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:07.279453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:07.279453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:07.279453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:07.279453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:07.279453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:07.279453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:07.279453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:07.279453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:07.279453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:07.279453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:07.279453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:07.279453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:07.295740 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 173/339] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:07.296039 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234f5ec-0b89-4101-b4aa-13cdc95c4a05 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1040aaac-d30d-4960-9d41-503746ebd2ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:07.296532 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:07.297423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:07.298198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:07.298198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:07.298198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:07.298198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:07.298198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:07.298198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:07.298198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:07.298198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:07.298198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:07.298198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:07.298198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:51:07.298198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:07.303966 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 167/340] 10.222.0.43 () {56 vars in 1114 bytes} [Wed May 25 13:51:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:07.310503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040aaac-d30d-4960-9d41-503746ebd2ba None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:07.335108 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:07.408086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:07.505929 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234f5ec-0b89-4101-b4aa-13cdc95c4a05 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:07.535964 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040aaac-d30d-4960-9d41-503746ebd2ba None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:07.563917 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a61d70-589f-46a0-a67e-bfa14d8553f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:07.564656 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a61d70-589f-46a0-a67e-bfa14d8553f8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.564941 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a61d70-589f-46a0-a67e-bfa14d8553f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.565217 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a61d70-589f-46a0-a67e-bfa14d8553f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:07.566496 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a61d70-589f-46a0-a67e-bfa14d8553f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:07.566838 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a61d70-589f-46a0-a67e-bfa14d8553f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:07.568281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a61d70-589f-46a0-a67e-bfa14d8553f8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:07.584861 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 174/341] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:51:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:07.590172 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a61d70-589f-46a0-a67e-bfa14d8553f8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:07.599637 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212932-845c-45d8-9707-dd586bdcd7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:07.603138 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212932-845c-45d8-9707-dd586bdcd7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.603138 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212932-845c-45d8-9707-dd586bdcd7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.603138 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212932-845c-45d8-9707-dd586bdcd7a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:07.603138 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10212932-845c-45d8-9707-dd586bdcd7a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:07.603138 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10212932-845c-45d8-9707-dd586bdcd7a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:07.608497 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10212932-845c-45d8-9707-dd586bdcd7a8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:07.623425 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 168/342] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:07.629956 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212932-845c-45d8-9707-dd586bdcd7a8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:07.786166 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a61d70-589f-46a0-a67e-bfa14d8553f8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:07.817668 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:07.819465 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:07.859984 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e3b58-5a91-4683-a9de-9df9503e83c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:07.860697 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3b58-5a91-4683-a9de-9df9503e83c2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.860979 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3b58-5a91-4683-a9de-9df9503e83c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.861255 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3b58-5a91-4683-a9de-9df9503e83c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:07.886739 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212932-845c-45d8-9707-dd586bdcd7a8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:07.961755 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee034e8e-d633-460d-a80d-3c2f8d7af78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:07.962417 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee034e8e-d633-460d-a80d-3c2f8d7af78b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.962697 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee034e8e-d633-460d-a80d-3c2f8d7af78b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.962975 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee034e8e-d633-460d-a80d-3c2f8d7af78b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.008860 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e3b58-5a91-4683-a9de-9df9503e83c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:08.010339 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e3b58-5a91-4683-a9de-9df9503e83c2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:08.099116 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee034e8e-d633-460d-a80d-3c2f8d7af78b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:08.100556 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee034e8e-d633-460d-a80d-3c2f8d7af78b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:08.174293 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 175/343] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:08.178807 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40c6fe-2ee2-429f-8e91-9ffe508f1ff7 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.179104 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40c6fe-2ee2-429f-8e91-9ffe508f1ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.179389 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40c6fe-2ee2-429f-8e91-9ffe508f1ff7 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.181092 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 176/344] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:08.182460 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec98486-e490-4b90-b73e-0b17337d8c88 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.182659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec98486-e490-4b90-b73e-0b17337d8c88 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.182940 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec98486-e490-4b90-b73e-0b17337d8c88 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.184455 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 177/345] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:08.185570 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757285-316b-465e-938b-34fcf93231d9 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.185854 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757285-316b-465e-938b-34fcf93231d9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.186135 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757285-316b-465e-938b-34fcf93231d9 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.189841 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:08.192620 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 178/346] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:08.193811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d757285-316b-465e-938b-34fcf93231d9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:08.212501 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:08.233384 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 169/347] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:51:08.236793 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d6e1d-0a04-43a2-8958-5c074e9e1772 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.237078 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d6e1d-0a04-43a2-8958-5c074e9e1772 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.237355 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d6e1d-0a04-43a2-8958-5c074e9e1772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.258164 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8b0d6e1d-0a04-43a2-8958-5c074e9e1772 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:08.259409 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8b0d6e1d-0a04-43a2-8958-5c074e9e1772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:08.336470 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d757285-316b-465e-938b-34fcf93231d9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:08.348480 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 170/348] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:08.355109 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541110e-2a88-4690-a8b4-2beb2110fe9b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.355109 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541110e-2a88-4690-a8b4-2beb2110fe9b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.355109 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541110e-2a88-4690-a8b4-2beb2110fe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.374095 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8541110e-2a88-4690-a8b4-2beb2110fe9b None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:08.375570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8541110e-2a88-4690-a8b4-2beb2110fe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:08.387655 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34d477-4172-49b1-a010-a8712ab63971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:08.388651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34d477-4172-49b1-a010-a8712ab63971 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.389353 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34d477-4172-49b1-a010-a8712ab63971 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.389648 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34d477-4172-49b1-a010-a8712ab63971 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.391158 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34d477-4172-49b1-a010-a8712ab63971 None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:08.392980 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34d477-4172-49b1-a010-a8712ab63971 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:08.396347 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 179/349] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:08 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:08.401194 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e36b6-09d4-43f2-9657-83e34d0cf161 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.401664 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e36b6-09d4-43f2-9657-83e34d0cf161 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.402095 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e36b6-09d4-43f2-9657-83e34d0cf161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.422585 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-463e36b6-09d4-43f2-9657-83e34d0cf161 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:08.423786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-463e36b6-09d4-43f2-9657-83e34d0cf161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:08.470396 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 171/350] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:08.471232 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541110e-2a88-4690-a8b4-2beb2110fe9b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:08.510323 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 180/351] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:08.511505 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e36b6-09d4-43f2-9657-83e34d0cf161 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:08.521411 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:08.535128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:08.613230 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541110e-2a88-4690-a8b4-2beb2110fe9b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:08.639134 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e36b6-09d4-43f2-9657-83e34d0cf161 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:08.653213 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711ebee-62e2-4b73-8cc6-9f197ab76632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:08.654090 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711ebee-62e2-4b73-8cc6-9f197ab76632 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.654483 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711ebee-62e2-4b73-8cc6-9f197ab76632 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.654765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711ebee-62e2-4b73-8cc6-9f197ab76632 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.655985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711ebee-62e2-4b73-8cc6-9f197ab76632 None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:08.657430 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711ebee-62e2-4b73-8cc6-9f197ab76632 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:08.660333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 172/352] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:08 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:08.661154 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711ebee-62e2-4b73-8cc6-9f197ab76632 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:08.683328 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424c390-89ad-4f29-a235-3020b1b6c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:08.684541 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424c390-89ad-4f29-a235-3020b1b6c33a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.685435 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424c390-89ad-4f29-a235-3020b1b6c33a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.685923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424c390-89ad-4f29-a235-3020b1b6c33a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.701003 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424c390-89ad-4f29-a235-3020b1b6c33a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-1424c390-89ad-4f29-a235-3020b1b6c33a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:08.709704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:08.710679 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:08.711484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:08.711484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:08.711484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:08.711484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:08.711484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:08.711484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:08.711484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:08.711484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:08.711484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:08.711484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:08.711484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:08.711484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:08.714110 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 181/353] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:08.715488 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424c390-89ad-4f29-a235-3020b1b6c33a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:08.808708 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711ebee-62e2-4b73-8cc6-9f197ab76632 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:08.810946 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:08.816383 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:08.852063 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424c390-89ad-4f29-a235-3020b1b6c33a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:08.864781 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151268df-4d43-4a0f-b912-d2e57f203148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:08.865575 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151268df-4d43-4a0f-b912-d2e57f203148 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.865858 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151268df-4d43-4a0f-b912-d2e57f203148 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.866143 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151268df-4d43-4a0f-b912-d2e57f203148 None admin] PATH_INFO: `/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.876228 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151268df-4d43-4a0f-b912-d2e57f203148 None admin] RBAC: Authorizing `identity:get_group(group_id=092e7e70b9574e8bb0bf7f657bb4da5c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:08.877228 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151268df-4d43-4a0f-b912-d2e57f203148 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:08.879206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 173/354] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:08 2022] GET /identity/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:08.880815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151268df-4d43-4a0f-b912-d2e57f203148 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:08.904249 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326cce4-3a46-4103-9302-a3e92f78f59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:08.905057 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326cce4-3a46-4103-9302-a3e92f78f59b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.905342 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326cce4-3a46-4103-9302-a3e92f78f59b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.906250 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326cce4-3a46-4103-9302-a3e92f78f59b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.921239 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326cce4-3a46-4103-9302-a3e92f78f59b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f326cce4-3a46-4103-9302-a3e92f78f59b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:08.930406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:08.931360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:08.932178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:08.932178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:08.932178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:08.932178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:08.932178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:08.932178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:08.932178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:08.932178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:08.932178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:08.932178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:08.932178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:51:08.932178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:08.936013 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 182/355] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:08.936740 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326cce4-3a46-4103-9302-a3e92f78f59b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.002118 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151268df-4d43-4a0f-b912-d2e57f203148 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.041495 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b626c0-c476-4577-b9bc-dc5c917ba350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.042551 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b626c0-c476-4577-b9bc-dc5c917ba350 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.042840 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b626c0-c476-4577-b9bc-dc5c917ba350 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.043121 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b626c0-c476-4577-b9bc-dc5c917ba350 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.060260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b626c0-c476-4577-b9bc-dc5c917ba350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:09.063077 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326cce4-3a46-4103-9302-a3e92f78f59b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-31b626c0-c476-4577-b9bc-dc5c917ba350 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:09.070382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:09.071319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:09.072190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:09.072190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:09.072190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:09.072190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:09.072190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:09.072190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:09.072190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:09.072190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:09.072190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:09.072190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:09.072190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:51:09.072190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:09.072190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 174/356] 10.222.0.43 () {56 vars in 1114 bytes} [Wed May 25 13:51:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:09.073509 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b626c0-c476-4577-b9bc-dc5c917ba350 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.098489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:09.102736 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:09.104822 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a116c0-41dd-4cde-882e-40ed28025688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.105670 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a116c0-41dd-4cde-882e-40ed28025688 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.105950 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a116c0-41dd-4cde-882e-40ed28025688 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.106225 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a116c0-41dd-4cde-882e-40ed28025688 None admin] PATH_INFO: `/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.107380 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a116c0-41dd-4cde-882e-40ed28025688 None admin] RBAC: Authorizing `identity:get_group(group_id=092e7e70b9574e8bb0bf7f657bb4da5c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:09.109019 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a116c0-41dd-4cde-882e-40ed28025688 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:09.112568 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 183/357] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:08 2022] GET /identity/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:09.112568 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a116c0-41dd-4cde-882e-40ed28025688 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.197420 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b626c0-c476-4577-b9bc-dc5c917ba350 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.240057 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6744b-0a68-4c72-9bc4-a2d33d5f64bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.240735 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6744b-0a68-4c72-9bc4-a2d33d5f64bf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.241017 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6744b-0a68-4c72-9bc4-a2d33d5f64bf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.241292 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6744b-0a68-4c72-9bc4-a2d33d5f64bf None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.242293 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6744b-0a68-4c72-9bc4-a2d33d5f64bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:09.242403 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6744b-0a68-4c72-9bc4-a2d33d5f64bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:09.243901 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6744b-0a68-4c72-9bc4-a2d33d5f64bf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:09.246802 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a116c0-41dd-4cde-882e-40ed28025688 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.252853 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 175/358] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:51:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:09.254662 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213e070-7285-4634-a240-aae51642c862 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.254985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213e070-7285-4634-a240-aae51642c862 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.254985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213e070-7285-4634-a240-aae51642c862 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.257542 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 176/359] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:09.258249 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213e070-7285-4634-a240-aae51642c862 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.287395 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19285462-833f-4dad-8764-817185085412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.288079 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19285462-833f-4dad-8764-817185085412 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.291124 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19285462-833f-4dad-8764-817185085412 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.291124 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19285462-833f-4dad-8764-817185085412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.291124 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19285462-833f-4dad-8764-817185085412 None admin] RBAC: Adding query filter params (group.id=092e7e70b9574e8bb0bf7f657bb4da5c, role.id=997ba13b80634887b0a7e88cbf2b2e62, scope.project.id=66a86bd19c83439885fcd12d7fb788d3) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:09.291124 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19285462-833f-4dad-8764-817185085412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:09.291443 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19285462-833f-4dad-8764-817185085412 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:09.298583 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 184/360] 10.222.0.43 () {56 vars in 1376 bytes} [Wed May 25 13:51:09 2022] GET /identity/v3/role_assignments?group.id=092e7e70b9574e8bb0bf7f657bb4da5c&scope.project.id=66a86bd19c83439885fcd12d7fb788d3&role.id=997ba13b80634887b0a7e88cbf2b2e62 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:09.299409 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19285462-833f-4dad-8764-817185085412 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.388030 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:09.393511 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:09.412146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213e070-7285-4634-a240-aae51642c862 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.460797 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19285462-833f-4dad-8764-817185085412 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.465797 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e5b45-a2f4-4683-b06a-1cd8fc927722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.466478 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5b45-a2f4-4683-b06a-1cd8fc927722 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.466761 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5b45-a2f4-4683-b06a-1cd8fc927722 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.467037 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5b45-a2f4-4683-b06a-1cd8fc927722 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.467833 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e5b45-a2f4-4683-b06a-1cd8fc927722 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:09.468143 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e5b45-a2f4-4683-b06a-1cd8fc927722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:09.470993 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e5b45-a2f4-4683-b06a-1cd8fc927722 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:09.484105 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 177/361] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:51:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:09.485307 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e5b45-a2f4-4683-b06a-1cd8fc927722 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.516356 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787b7d7-5176-439e-a465-c97034321f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.517067 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787b7d7-5176-439e-a465-c97034321f73 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.517348 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787b7d7-5176-439e-a465-c97034321f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.517622 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787b7d7-5176-439e-a465-c97034321f73 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.518376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787b7d7-5176-439e-a465-c97034321f73 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:09.518681 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787b7d7-5176-439e-a465-c97034321f73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:09.522008 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787b7d7-5176-439e-a465-c97034321f73 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:09.532023 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 185/362] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:09.533265 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787b7d7-5176-439e-a465-c97034321f73 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.635465 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e5b45-a2f4-4683-b06a-1cd8fc927722 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.668085 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787b7d7-5176-439e-a465-c97034321f73 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.681087 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885808d-8d81-412f-a10c-dfdbe9350906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.681924 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885808d-8d81-412f-a10c-dfdbe9350906 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.682278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885808d-8d81-412f-a10c-dfdbe9350906 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.682563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885808d-8d81-412f-a10c-dfdbe9350906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.683410 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885808d-8d81-412f-a10c-dfdbe9350906 None admin] RBAC: Adding query filter params (group.id=092e7e70b9574e8bb0bf7f657bb4da5c, role.id=9ba48b8364e040eb829f7c1e7662f8d3, scope.project.id=66a86bd19c83439885fcd12d7fb788d3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:09.684354 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885808d-8d81-412f-a10c-dfdbe9350906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:09.685923 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885808d-8d81-412f-a10c-dfdbe9350906 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:09.692733 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 178/363] 10.222.0.43 () {56 vars in 1376 bytes} [Wed May 25 13:51:09 2022] GET /identity/v3/role_assignments?group.id=092e7e70b9574e8bb0bf7f657bb4da5c&scope.project.id=66a86bd19c83439885fcd12d7fb788d3&role.id=9ba48b8364e040eb829f7c1e7662f8d3 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:09.694191 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14cfe0-8a20-4c89-845c-921403c757ce None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.694486 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14cfe0-8a20-4c89-845c-921403c757ce None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.694768 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14cfe0-8a20-4c89-845c-921403c757ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.698490 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:09.709409 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef5f04-faf1-49a7-8fa8-11ff6732be8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.717018 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef5f04-faf1-49a7-8fa8-11ff6732be8c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.717018 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef5f04-faf1-49a7-8fa8-11ff6732be8c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.717018 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef5f04-faf1-49a7-8fa8-11ff6732be8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.721510 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1d14cfe0-8a20-4c89-845c-921403c757ce None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:09.723517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1d14cfe0-8a20-4c89-845c-921403c757ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:09.728141 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:09.798486 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef5f04-faf1-49a7-8fa8-11ff6732be8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:09.800442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef5f04-faf1-49a7-8fa8-11ff6732be8c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:09.821618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 179/364] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:09.822509 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14cfe0-8a20-4c89-845c-921403c757ce None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.950525 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14cfe0-8a20-4c89-845c-921403c757ce None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.953768 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 186/365] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:09.954260 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef5f04-faf1-49a7-8fa8-11ff6732be8c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.988159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:10.026940 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d28a04-6008-4c0e-86ec-c20daf570c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.027874 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d28a04-6008-4c0e-86ec-c20daf570c67 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.028155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d28a04-6008-4c0e-86ec-c20daf570c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.028426 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d28a04-6008-4c0e-86ec-c20daf570c67 None admin] PATH_INFO: `/v3/users/60964ac7f9c5490c9df6eea3ecd09e0d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.029745 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d28a04-6008-4c0e-86ec-c20daf570c67 None admin] RBAC: Authorizing `identity:get_user(user_id=60964ac7f9c5490c9df6eea3ecd09e0d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.031292 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d28a04-6008-4c0e-86ec-c20daf570c67 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.033394 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 180/366] 10.222.0.43 () {56 vars in 1177 bytes} [Wed May 25 13:51:09 2022] GET /identity/v3/users/60964ac7f9c5490c9df6eea3ecd09e0d => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:10.034283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d28a04-6008-4c0e-86ec-c20daf570c67 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.054572 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:10.087926 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef5f04-faf1-49a7-8fa8-11ff6732be8c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.136006 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ed2e4-5811-4955-a0e1-9e6e2298b435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.136662 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ed2e4-5811-4955-a0e1-9e6e2298b435 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.136943 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ed2e4-5811-4955-a0e1-9e6e2298b435 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.138076 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ed2e4-5811-4955-a0e1-9e6e2298b435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.186716 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d28a04-6008-4c0e-86ec-c20daf570c67 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.234613 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7f7ac-2a51-4b3a-b2c5-dceb7a459855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.236049 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7f7ac-2a51-4b3a-b2c5-dceb7a459855 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.236336 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7f7ac-2a51-4b3a-b2c5-dceb7a459855 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.236882 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7f7ac-2a51-4b3a-b2c5-dceb7a459855 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.237405 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ed2e4-5811-4955-a0e1-9e6e2298b435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.242190 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ed2e4-5811-4955-a0e1-9e6e2298b435 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.250654 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7f7ac-2a51-4b3a-b2c5-dceb7a459855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8da7f7ac-2a51-4b3a-b2c5-dceb7a459855 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:10.261999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:10.262998 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:10.263790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:10.263790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:10.263790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:10.263790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:10.263790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:10.263790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:10.263790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:10.263790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:10.263790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:10.263790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:10.263790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:51:10.263790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:10.264426 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 181/367] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:10.267833 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7f7ac-2a51-4b3a-b2c5-dceb7a459855 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.279009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:10.369996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:10.375437 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 187/368] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:10.376498 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ed2e4-5811-4955-a0e1-9e6e2298b435 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.422674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7f7ac-2a51-4b3a-b2c5-dceb7a459855 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.471180 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723d5da-6791-476b-949c-808ebd9a861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.472106 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723d5da-6791-476b-949c-808ebd9a861b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.472387 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723d5da-6791-476b-949c-808ebd9a861b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.472660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723d5da-6791-476b-949c-808ebd9a861b None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.475112 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723d5da-6791-476b-949c-808ebd9a861b None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.477682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723d5da-6791-476b-949c-808ebd9a861b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.479089 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 182/369] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:10.480010 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723d5da-6791-476b-949c-808ebd9a861b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.508456 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ed2e4-5811-4955-a0e1-9e6e2298b435 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.544034 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:10.559212 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb6cc6-a74c-49c0-8634-70216ec0f540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.560169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb6cc6-a74c-49c0-8634-70216ec0f540 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.560459 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb6cc6-a74c-49c0-8634-70216ec0f540 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.560736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb6cc6-a74c-49c0-8634-70216ec0f540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.561623 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb6cc6-a74c-49c0-8634-70216ec0f540 None admin] RBAC: Adding query filter params (role.id=36d58da2a9494447b686349f4426d7d7, user.id=60964ac7f9c5490c9df6eea3ecd09e0d, scope.system=all) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:10.561938 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb6cc6-a74c-49c0-8634-70216ec0f540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.563567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb6cc6-a74c-49c0-8634-70216ec0f540 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.579359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 188/370] 10.222.0.43 () {56 vars in 1308 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/role_assignments?user.id=60964ac7f9c5490c9df6eea3ecd09e0d&scope.system=all&role.id=36d58da2a9494447b686349f4426d7d7 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:10.580796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb6cc6-a74c-49c0-8634-70216ec0f540 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.612176 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723d5da-6791-476b-949c-808ebd9a861b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.704250 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68f923-705f-4ee6-9f7a-5011e6af0de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.704934 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68f923-705f-4ee6-9f7a-5011e6af0de9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.705216 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68f923-705f-4ee6-9f7a-5011e6af0de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.705493 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68f923-705f-4ee6-9f7a-5011e6af0de9 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.706289 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68f923-705f-4ee6-9f7a-5011e6af0de9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:10.706598 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68f923-705f-4ee6-9f7a-5011e6af0de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.708760 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68f923-705f-4ee6-9f7a-5011e6af0de9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.718307 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:10.728146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 183/371] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:10.735106 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68f923-705f-4ee6-9f7a-5011e6af0de9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.735245 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb6cc6-a74c-49c0-8634-70216ec0f540 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.812411 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f337f8-3d91-4d78-b92b-c694a602c909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.813292 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f337f8-3d91-4d78-b92b-c694a602c909 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.813578 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f337f8-3d91-4d78-b92b-c694a602c909 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.813853 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f337f8-3d91-4d78-b92b-c694a602c909 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.816574 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f337f8-3d91-4d78-b92b-c694a602c909 None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.818514 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f337f8-3d91-4d78-b92b-c694a602c909 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.820630 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 189/372] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:10.821802 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f337f8-3d91-4d78-b92b-c694a602c909 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.864979 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68f923-705f-4ee6-9f7a-5011e6af0de9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.886587 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:10.905066 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a4d45-2c38-4a52-b29d-2549417d7bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.906259 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a4d45-2c38-4a52-b29d-2549417d7bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.906759 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a4d45-2c38-4a52-b29d-2549417d7bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.907241 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a4d45-2c38-4a52-b29d-2549417d7bb6 None admin] PATH_INFO: `/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.908740 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a4d45-2c38-4a52-b29d-2549417d7bb6 None admin] RBAC: Authorizing `identity:get_group(group_id=092e7e70b9574e8bb0bf7f657bb4da5c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.910541 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a4d45-2c38-4a52-b29d-2549417d7bb6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.912541 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 184/373] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:10.913519 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a4d45-2c38-4a52-b29d-2549417d7bb6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.943809 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f337f8-3d91-4d78-b92b-c694a602c909 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.985731 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab25e4-0736-46d1-ab42-579c8bc89ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.986395 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab25e4-0736-46d1-ab42-579c8bc89ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.986673 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab25e4-0736-46d1-ab42-579c8bc89ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.986949 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab25e4-0736-46d1-ab42-579c8bc89ca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.004551 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:11.060443 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a4d45-2c38-4a52-b29d-2549417d7bb6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:11.093825 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab25e4-0736-46d1-ab42-579c8bc89ca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:11.095232 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab25e4-0736-46d1-ab42-579c8bc89ca5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:11.107963 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4333243-7f2d-46f0-848d-20bd4125ac77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:11.109248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333243-7f2d-46f0-848d-20bd4125ac77 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.109671 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333243-7f2d-46f0-848d-20bd4125ac77 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.110089 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333243-7f2d-46f0-848d-20bd4125ac77 None admin] PATH_INFO: `/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.111529 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4333243-7f2d-46f0-848d-20bd4125ac77 None admin] RBAC: Authorizing `identity:get_group(group_id=092e7e70b9574e8bb0bf7f657bb4da5c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:11.114371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4333243-7f2d-46f0-848d-20bd4125ac77 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:11.116682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 185/374] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:11.117469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4333243-7f2d-46f0-848d-20bd4125ac77 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:11.162808 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:11.224308 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 190/375] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:11.225242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab25e4-0736-46d1-ab42-579c8bc89ca5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:11.248759 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4333243-7f2d-46f0-848d-20bd4125ac77 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:11.289287 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c2455-9b9c-4a31-ba6b-12e6b7cb11f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:11.289999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c2455-9b9c-4a31-ba6b-12e6b7cb11f0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.290286 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c2455-9b9c-4a31-ba6b-12e6b7cb11f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.290564 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c2455-9b9c-4a31-ba6b-12e6b7cb11f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.291400 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c2455-9b9c-4a31-ba6b-12e6b7cb11f0 None admin] RBAC: Adding query filter params (group.id=092e7e70b9574e8bb0bf7f657bb4da5c, role.id=997ba13b80634887b0a7e88cbf2b2e62, scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:11.291733 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c2455-9b9c-4a31-ba6b-12e6b7cb11f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:11.294201 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c2455-9b9c-4a31-ba6b-12e6b7cb11f0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:11.296310 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:11.301595 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 186/376] 10.222.0.43 () {56 vars in 1376 bytes} [Wed May 25 13:51:11 2022] GET /identity/v3/role_assignments?group.id=092e7e70b9574e8bb0bf7f657bb4da5c&scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9&role.id=997ba13b80634887b0a7e88cbf2b2e62 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:11.302598 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c2455-9b9c-4a31-ba6b-12e6b7cb11f0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:11.344887 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab25e4-0736-46d1-ab42-579c8bc89ca5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:11.390911 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa68876-b597-44b4-b018-fcbf3d506307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:11.391594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa68876-b597-44b4-b018-fcbf3d506307 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.391909 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa68876-b597-44b4-b018-fcbf3d506307 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.392190 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa68876-b597-44b4-b018-fcbf3d506307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.393084 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa68876-b597-44b4-b018-fcbf3d506307 None admin] RBAC: Adding query filter params (group.id=092e7e70b9574e8bb0bf7f657bb4da5c, role.id=9ba48b8364e040eb829f7c1e7662f8d3, scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:11.393407 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa68876-b597-44b4-b018-fcbf3d506307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:11.394997 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa68876-b597-44b4-b018-fcbf3d506307 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:11.401691 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 191/377] 10.222.0.43 () {56 vars in 1376 bytes} [Wed May 25 13:51:11 2022] GET /identity/v3/role_assignments?group.id=092e7e70b9574e8bb0bf7f657bb4da5c&scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9&role.id=9ba48b8364e040eb829f7c1e7662f8d3 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:11.512217 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c2455-9b9c-4a31-ba6b-12e6b7cb11f0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:11.590264 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd8dee-282f-4dd8-b080-d4aff8bafeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:11.591147 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd8dee-282f-4dd8-b080-d4aff8bafeef None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.591424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd8dee-282f-4dd8-b080-d4aff8bafeef None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.591694 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd8dee-282f-4dd8-b080-d4aff8bafeef None admin] PATH_INFO: `/v3/projects/8a4f621a835a4791ab184efa095e7a24` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.594720 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd8dee-282f-4dd8-b080-d4aff8bafeef None admin] RBAC: Authorizing `identity:get_project(project_id=8a4f621a835a4791ab184efa095e7a24)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:11.596262 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd8dee-282f-4dd8-b080-d4aff8bafeef None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:11.599887 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 187/378] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:11 2022] GET /identity/v3/projects/8a4f621a835a4791ab184efa095e7a24 => generated 344 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:11.604490 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa68876-b597-44b4-b018-fcbf3d506307 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:11.641856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:11.760893 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa68876-b597-44b4-b018-fcbf3d506307 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:11.804534 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8b027-5998-4536-8658-797f225cb0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:11.805415 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8b027-5998-4536-8658-797f225cb0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.805697 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8b027-5998-4536-8658-797f225cb0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.805972 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8b027-5998-4536-8658-797f225cb0d9 None admin] PATH_INFO: `/v3/groups/1993614fc44140418c2408dee7b693e0` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.816468 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8b027-5998-4536-8658-797f225cb0d9 None admin] RBAC: Authorizing `identity:get_group(group_id=1993614fc44140418c2408dee7b693e0)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:11.818672 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8b027-5998-4536-8658-797f225cb0d9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:11.820776 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 192/379] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:11 2022] GET /identity/v3/groups/1993614fc44140418c2408dee7b693e0 => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:11.826352 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd8dee-282f-4dd8-b080-d4aff8bafeef None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:11.861129 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7594cd3-0d4d-42e1-8f5c-1d4ea75fbead None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.861316 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7594cd3-0d4d-42e1-8f5c-1d4ea75fbead None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.861609 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7594cd3-0d4d-42e1-8f5c-1d4ea75fbead None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.863218 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 193/380] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:11.869936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed5dd-2c89-42b3-aeaa-e979ab570f34 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.870225 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed5dd-2c89-42b3-aeaa-e979ab570f34 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.870509 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed5dd-2c89-42b3-aeaa-e979ab570f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.904801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3c1ed5dd-2c89-42b3-aeaa-e979ab570f34 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:11.906991 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3c1ed5dd-2c89-42b3-aeaa-e979ab570f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:11.918588 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:12.004296 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 194/381] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:51:12.006988 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd8dee-282f-4dd8-b080-d4aff8bafeef None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:12.039491 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ed5dd-2c89-42b3-aeaa-e979ab570f34 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:12.067292 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:12.092679 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0aeb4e-3844-468a-817b-f82462f7c9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:12.093772 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aeb4e-3844-468a-817b-f82462f7c9ea None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:12.095119 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aeb4e-3844-468a-817b-f82462f7c9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:12.096967 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aeb4e-3844-468a-817b-f82462f7c9ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:12.102192 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0aeb4e-3844-468a-817b-f82462f7c9ea None admin] RBAC: Adding query filter params (group.id=1993614fc44140418c2408dee7b693e0, role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5, scope.project.id=8a4f621a835a4791ab184efa095e7a24) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:12.102925 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0aeb4e-3844-468a-817b-f82462f7c9ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:12.104760 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0aeb4e-3844-468a-817b-f82462f7c9ea None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:12.119813 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 188/382] 10.222.0.43 () {56 vars in 1376 bytes} [Wed May 25 13:51:11 2022] GET /identity/v3/role_assignments?group.id=1993614fc44140418c2408dee7b693e0&scope.project.id=8a4f621a835a4791ab184efa095e7a24&role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5 => generated 260 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:12.203954 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ed5dd-2c89-42b3-aeaa-e979ab570f34 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:12.281396 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779c5fa-66ae-4e3f-bc5a-383f3c8d8f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:12.282220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779c5fa-66ae-4e3f-bc5a-383f3c8d8f66 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:12.282503 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779c5fa-66ae-4e3f-bc5a-383f3c8d8f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:12.282776 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779c5fa-66ae-4e3f-bc5a-383f3c8d8f66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:12.310272 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779c5fa-66ae-4e3f-bc5a-383f3c8d8f66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5779c5fa-66ae-4e3f-bc5a-383f3c8d8f66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:12.318961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:12.319896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:12.320688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:12.320688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:12.320688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:12.320688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:12.320688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:12.320688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:12.320688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:12.320688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:12.320688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:12.320688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:12.320688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:12.320688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:12.320688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 195/383] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:12.325969 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0aeb4e-3844-468a-817b-f82462f7c9ea None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:12.387645 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b5e7-9e3d-48fb-87f3-8d961e54a3e7 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:12.389090 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b5e7-9e3d-48fb-87f3-8d961e54a3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:12.389722 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b5e7-9e3d-48fb-87f3-8d961e54a3e7 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:12.392813 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 196/384] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:51:12.401451 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049bc75-a448-41a4-9c53-909398b89c5b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:12.402055 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049bc75-a448-41a4-9c53-909398b89c5b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:12.402524 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049bc75-a448-41a4-9c53-909398b89c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:12.440727 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9049bc75-a448-41a4-9c53-909398b89c5b None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:12.442891 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9049bc75-a448-41a4-9c53-909398b89c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:12.449715 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0aeb4e-3844-468a-817b-f82462f7c9ea None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:12.487469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca2e1-1c46-489c-899b-fe0df5358f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:12.488813 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca2e1-1c46-489c-899b-fe0df5358f03 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:12.489119 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca2e1-1c46-489c-899b-fe0df5358f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:12.489401 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca2e1-1c46-489c-899b-fe0df5358f03 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:12.490348 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fca2e1-1c46-489c-899b-fe0df5358f03 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:12.490663 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fca2e1-1c46-489c-899b-fe0df5358f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:12.492427 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fca2e1-1c46-489c-899b-fe0df5358f03 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:12.502601 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 189/385] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:51:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:12.502909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:12.509511 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca2e1-1c46-489c-899b-fe0df5358f03 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:12.631709 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca2e1-1c46-489c-899b-fe0df5358f03 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:12.641146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:12.657095 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 197/386] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:12.671163 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c6521-c392-41bd-a327-771b40729b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:12.672312 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c6521-c392-41bd-a327-771b40729b23 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:12.672938 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c6521-c392-41bd-a327-771b40729b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:12.673474 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c6521-c392-41bd-a327-771b40729b23 None admin] PATH_INFO: `/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:12.674841 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c6521-c392-41bd-a327-771b40729b23 None admin] RBAC: Authorizing `identity:get_group(group_id=092e7e70b9574e8bb0bf7f657bb4da5c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:12.676650 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c6521-c392-41bd-a327-771b40729b23 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:12.678800 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 190/387] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:12 2022] GET /identity/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:12.687748 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049bc75-a448-41a4-9c53-909398b89c5b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:12.688882 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c6521-c392-41bd-a327-771b40729b23 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:12.788088 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:12.830225 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049bc75-a448-41a4-9c53-909398b89c5b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:12.863767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c6521-c392-41bd-a327-771b40729b23 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:12.911785 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ff7ce-71a4-4c49-96cf-89d286bb698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:12.912524 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ff7ce-71a4-4c49-96cf-89d286bb698f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:12.912809 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ff7ce-71a4-4c49-96cf-89d286bb698f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:12.913087 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ff7ce-71a4-4c49-96cf-89d286bb698f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:12.921319 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63f8a-8c25-445a-9255-baf03b96f0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:12.922176 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63f8a-8c25-445a-9255-baf03b96f0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:12.922451 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63f8a-8c25-445a-9255-baf03b96f0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:12.922721 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63f8a-8c25-445a-9255-baf03b96f0e1 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:12.925871 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc63f8a-8c25-445a-9255-baf03b96f0e1 None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:12.927488 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc63f8a-8c25-445a-9255-baf03b96f0e1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:12.928536 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ff7ce-71a4-4c49-96cf-89d286bb698f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a03ff7ce-71a4-4c49-96cf-89d286bb698f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:12.936554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:12.937630 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:12.938603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:12.938603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:12.938603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:12.938603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:12.938603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:12.938603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:12.938603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:12.938603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:12.938603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:12.938603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:12.938603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:51:12.938603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:12.940026 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 191/389] 10.222.0.43 () {56 vars in 1114 bytes} [Wed May 25 13:51:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:12.944496 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 198/389] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:12 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:12.945537 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ff7ce-71a4-4c49-96cf-89d286bb698f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:12.946805 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63f8a-8c25-445a-9255-baf03b96f0e1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.016592 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:13.073572 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63f8a-8c25-445a-9255-baf03b96f0e1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.111192 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3bb7c-9649-44e4-960c-fc8b43aaf229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.111884 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3bb7c-9649-44e4-960c-fc8b43aaf229 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.112174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3bb7c-9649-44e4-960c-fc8b43aaf229 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.112449 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3bb7c-9649-44e4-960c-fc8b43aaf229 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.113186 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3bb7c-9649-44e4-960c-fc8b43aaf229 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:13.113607 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3bb7c-9649-44e4-960c-fc8b43aaf229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.114996 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3bb7c-9649-44e4-960c-fc8b43aaf229 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.127824 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 199/390] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:13.129873 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3bb7c-9649-44e4-960c-fc8b43aaf229 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.150101 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ff7ce-71a4-4c49-96cf-89d286bb698f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.183948 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:13.228416 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f1808-8501-41e0-87f0-164dbc4b66c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.229682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f1808-8501-41e0-87f0-164dbc4b66c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.230159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f1808-8501-41e0-87f0-164dbc4b66c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.230641 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f1808-8501-41e0-87f0-164dbc4b66c3 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3/groups/092e7e70b9574e8bb0bf7f657bb4da5c/roles/997ba13b80634887b0a7e88cbf2b2e62` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.235649 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f1808-8501-41e0-87f0-164dbc4b66c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=66a86bd19c83439885fcd12d7fb788d3, group_id=092e7e70b9574e8bb0bf7f657bb4da5c, role_id=997ba13b80634887b0a7e88cbf2b2e62)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.237326 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f1808-8501-41e0-87f0-164dbc4b66c3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.245667 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3bb7c-9649-44e4-960c-fc8b43aaf229 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.284365 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d61cb4-d618-4252-8b18-85494f9d3052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.286307 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d61cb4-d618-4252-8b18-85494f9d3052 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.286609 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d61cb4-d618-4252-8b18-85494f9d3052 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.286894 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d61cb4-d618-4252-8b18-85494f9d3052 None admin] PATH_INFO: `/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.288154 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d61cb4-d618-4252-8b18-85494f9d3052 None admin] RBAC: Authorizing `identity:get_group(group_id=092e7e70b9574e8bb0bf7f657bb4da5c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.289874 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d61cb4-d618-4252-8b18-85494f9d3052 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.293127 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:13.293260 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 200/391] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:13 2022] GET /identity/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:13.302009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d61cb4-d618-4252-8b18-85494f9d3052 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.366417 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 192/392] 10.222.0.43 () {58 vars in 1442 bytes} [Wed May 25 13:51:12 2022] PUT /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3/groups/092e7e70b9574e8bb0bf7f657bb4da5c/roles/997ba13b80634887b0a7e88cbf2b2e62 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:13.418380 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d61cb4-d618-4252-8b18-85494f9d3052 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.456928 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76002c9-2e75-429f-8125-900bd92d5264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.458407 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76002c9-2e75-429f-8125-900bd92d5264 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.458713 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76002c9-2e75-429f-8125-900bd92d5264 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.458993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76002c9-2e75-429f-8125-900bd92d5264 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.464213 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76002c9-2e75-429f-8125-900bd92d5264 None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.466170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76002c9-2e75-429f-8125-900bd92d5264 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.471898 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 201/393] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:13 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:13.476887 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f1808-8501-41e0-87f0-164dbc4b66c3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.649782 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f1808-8501-41e0-87f0-164dbc4b66c3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.686487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c081a62-02ac-4f30-907e-b2e4158a1ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.687412 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c081a62-02ac-4f30-907e-b2e4158a1ebb None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.687702 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c081a62-02ac-4f30-907e-b2e4158a1ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.688006 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c081a62-02ac-4f30-907e-b2e4158a1ebb None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3/groups/092e7e70b9574e8bb0bf7f657bb4da5c/roles/9ba48b8364e040eb829f7c1e7662f8d3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.690289 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c081a62-02ac-4f30-907e-b2e4158a1ebb None admin] RBAC: Authorizing `identity:create_grant(project_id=66a86bd19c83439885fcd12d7fb788d3, group_id=092e7e70b9574e8bb0bf7f657bb4da5c, role_id=9ba48b8364e040eb829f7c1e7662f8d3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.692845 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c081a62-02ac-4f30-907e-b2e4158a1ebb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.792807 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 193/394] 10.222.0.43 () {58 vars in 1442 bytes} [Wed May 25 13:51:13 2022] PUT /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3/groups/092e7e70b9574e8bb0bf7f657bb4da5c/roles/9ba48b8364e040eb829f7c1e7662f8d3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:14.024703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda4e34-a096-4ff8-ba58-7a1107714125 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.025244 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda4e34-a096-4ff8-ba58-7a1107714125 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.025244 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda4e34-a096-4ff8-ba58-7a1107714125 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.026907 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 202/395] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:14.032589 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31696c-ea8c-458e-a8eb-edf71c444550 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.032883 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31696c-ea8c-458e-a8eb-edf71c444550 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.033168 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31696c-ea8c-458e-a8eb-edf71c444550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.061088 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3a31696c-ea8c-458e-a8eb-edf71c444550 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:14.062265 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3a31696c-ea8c-458e-a8eb-edf71c444550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:14.108301 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:14.142475 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 194/396] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:14.154173 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80019bf2-3609-4b18-8877-c44e0acba21e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.154462 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80019bf2-3609-4b18-8877-c44e0acba21e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.154741 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80019bf2-3609-4b18-8877-c44e0acba21e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.156381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 203/397] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:14.166404 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cc76e-3b36-4cfb-b3d5-6bf11f6ce683 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.166974 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cc76e-3b36-4cfb-b3d5-6bf11f6ce683 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.166974 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cc76e-3b36-4cfb-b3d5-6bf11f6ce683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.173187 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80019bf2-3609-4b18-8877-c44e0acba21e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:14.188723 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6c0cc76e-3b36-4cfb-b3d5-6bf11f6ce683 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:14.189952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6c0cc76e-3b36-4cfb-b3d5-6bf11f6ce683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:14.306121 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 195/398] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:14.312142 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:14.358857 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80019bf2-3609-4b18-8877-c44e0acba21e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:14.362332 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cc76e-3b36-4cfb-b3d5-6bf11f6ce683 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:14.436908 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd98a3-da52-48c4-97b5-6a1dbd427e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:14.437710 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd98a3-da52-48c4-97b5-6a1dbd427e3d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.437989 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd98a3-da52-48c4-97b5-6a1dbd427e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.438262 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd98a3-da52-48c4-97b5-6a1dbd427e3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.461761 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd98a3-da52-48c4-97b5-6a1dbd427e3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-11dd98a3-da52-48c4-97b5-6a1dbd427e3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:14.471626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:14.473580 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:14.474358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:14.474358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:14.474358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:14.474358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:14.474358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:14.474358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:14.474358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:14.474358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:14.474358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:14.474358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:14.474358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:14.474358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:14.475441 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 204/399] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:14.483307 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd98a3-da52-48c4-97b5-6a1dbd427e3d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:14.529428 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:14.538948 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cc76e-3b36-4cfb-b3d5-6bf11f6ce683 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:14.608586 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916aec13-b208-49f8-9cdb-f66350809a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:14.609569 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916aec13-b208-49f8-9cdb-f66350809a4d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.609956 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916aec13-b208-49f8-9cdb-f66350809a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.610335 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916aec13-b208-49f8-9cdb-f66350809a4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.619801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd98a3-da52-48c4-97b5-6a1dbd427e3d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:14.648136 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:14.653960 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916aec13-b208-49f8-9cdb-f66350809a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:14.660955 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5cea0-629d-4029-8c6c-731898598223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-916aec13-b208-49f8-9cdb-f66350809a4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:14.664077 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:14.665233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:14.666220 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:14.666220 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:14.666220 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:14.666220 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:14.666220 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:14.666220 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:14.666220 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:14.666220 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:14.666220 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:14.666220 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:14.666220 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:51:14.666220 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:14.667773 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5cea0-629d-4029-8c6c-731898598223 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.668192 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5cea0-629d-4029-8c6c-731898598223 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.668646 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5cea0-629d-4029-8c6c-731898598223 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.669539 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5cea0-629d-4029-8c6c-731898598223 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:14.672322 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5cea0-629d-4029-8c6c-731898598223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:14.672322 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5cea0-629d-4029-8c6c-731898598223 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:14.673928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 196/400] 10.222.0.43 () {56 vars in 1114 bytes} [Wed May 25 13:51:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:14.688429 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 205/401] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:51:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:14.694513 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916aec13-b208-49f8-9cdb-f66350809a4d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:14.701053 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5cea0-629d-4029-8c6c-731898598223 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:14.821202 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5cea0-629d-4029-8c6c-731898598223 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:14.861975 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241e426-6ffd-4b46-9e3c-ec2f760883c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:14.863202 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e426-6ffd-4b46-9e3c-ec2f760883c6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.864148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e426-6ffd-4b46-9e3c-ec2f760883c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.864693 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e426-6ffd-4b46-9e3c-ec2f760883c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.865591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241e426-6ffd-4b46-9e3c-ec2f760883c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:14.866038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241e426-6ffd-4b46-9e3c-ec2f760883c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:14.867642 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241e426-6ffd-4b46-9e3c-ec2f760883c6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:14.876844 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 206/402] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:14.883871 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241e426-6ffd-4b46-9e3c-ec2f760883c6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:14.940131 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:14.986779 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916aec13-b208-49f8-9cdb-f66350809a4d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.011776 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241e426-6ffd-4b46-9e3c-ec2f760883c6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.047585 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bd6fd-9ed5-46b1-822d-81e0446765fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.048465 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bd6fd-9ed5-46b1-822d-81e0446765fe None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.048673 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cc2a9-2134-4709-a604-ebca2ec9809c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.048781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bd6fd-9ed5-46b1-822d-81e0446765fe None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.049011 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bd6fd-9ed5-46b1-822d-81e0446765fe None admin] PATH_INFO: `/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.049515 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cc2a9-2134-4709-a604-ebca2ec9809c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.049801 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cc2a9-2134-4709-a604-ebca2ec9809c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.050079 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cc2a9-2134-4709-a604-ebca2ec9809c None admin] PATH_INFO: `/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.050266 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bd6fd-9ed5-46b1-822d-81e0446765fe None admin] RBAC: Authorizing `identity:get_group(group_id=092e7e70b9574e8bb0bf7f657bb4da5c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.051488 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cc2a9-2134-4709-a604-ebca2ec9809c None admin] RBAC: Authorizing `identity:get_group(group_id=092e7e70b9574e8bb0bf7f657bb4da5c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.051934 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bd6fd-9ed5-46b1-822d-81e0446765fe None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.052931 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cc2a9-2134-4709-a604-ebca2ec9809c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.053874 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 207/403] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:14 2022] GET /identity/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:15.055048 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5d993-18b5-4128-b182-5f8e70bc0fd8 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.055389 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5d993-18b5-4128-b182-5f8e70bc0fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.055672 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5d993-18b5-4128-b182-5f8e70bc0fd8 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.057160 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 208/404] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:15.059541 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5d993-18b5-4128-b182-5f8e70bc0fd8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.060504 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 197/405] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:14 2022] GET /identity/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c => generated 226 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:15.064449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fd3ae-151b-4086-bbd5-a90ec6e5e731 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.064737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fd3ae-151b-4086-bbd5-a90ec6e5e731 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.065022 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fd3ae-151b-4086-bbd5-a90ec6e5e731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.083205 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-588fd3ae-151b-4086-bbd5-a90ec6e5e731 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:15.084646 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-588fd3ae-151b-4086-bbd5-a90ec6e5e731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:15.124227 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:15.164113 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 198/406] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:51:15.165106 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fd3ae-151b-4086-bbd5-a90ec6e5e731 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.170869 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5d993-18b5-4128-b182-5f8e70bc0fd8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.189458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:15.208527 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9014c0e-b9d9-4a41-8bd1-694b7ef595d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.209514 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9014c0e-b9d9-4a41-8bd1-694b7ef595d5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.209865 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9014c0e-b9d9-4a41-8bd1-694b7ef595d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.210250 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9014c0e-b9d9-4a41-8bd1-694b7ef595d5 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.211507 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9014c0e-b9d9-4a41-8bd1-694b7ef595d5 None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.213058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9014c0e-b9d9-4a41-8bd1-694b7ef595d5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.219747 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 209/407] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:15 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:15.219747 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9014c0e-b9d9-4a41-8bd1-694b7ef595d5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.302554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fd3ae-151b-4086-bbd5-a90ec6e5e731 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.337025 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9014c0e-b9d9-4a41-8bd1-694b7ef595d5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.340617 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7585bf-68ae-4c85-beca-976da8128384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.341679 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7585bf-68ae-4c85-beca-976da8128384 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.342133 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7585bf-68ae-4c85-beca-976da8128384 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.342603 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7585bf-68ae-4c85-beca-976da8128384 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.344010 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7585bf-68ae-4c85-beca-976da8128384 None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.345743 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7585bf-68ae-4c85-beca-976da8128384 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.348286 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 199/408] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:15 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:15.349327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7585bf-68ae-4c85-beca-976da8128384 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.387402 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:15.387570 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce210d3-5343-4c14-845e-445632cff32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.389481 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce210d3-5343-4c14-845e-445632cff32a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.389979 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce210d3-5343-4c14-845e-445632cff32a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.390408 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce210d3-5343-4c14-845e-445632cff32a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.405309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce210d3-5343-4c14-845e-445632cff32a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-cce210d3-5343-4c14-845e-445632cff32a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:15.415910 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:15.416936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:15.417735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:15.417735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:15.417735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:15.417735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:15.417735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:15.417735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:15.417735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:15.417735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:15.417735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:15.417735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:15.417735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:51:15.417735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:15.417735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 210/409] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:51:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:15.418375 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce210d3-5343-4c14-845e-445632cff32a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.474254 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:15.488728 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7585bf-68ae-4c85-beca-976da8128384 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.531156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce210d3-5343-4c14-845e-445632cff32a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.537715 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cec25-1be3-4b1f-8306-9c28ba70d4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.538601 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cec25-1be3-4b1f-8306-9c28ba70d4f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.538883 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cec25-1be3-4b1f-8306-9c28ba70d4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.539159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cec25-1be3-4b1f-8306-9c28ba70d4f5 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9/groups/092e7e70b9574e8bb0bf7f657bb4da5c/roles/9ba48b8364e040eb829f7c1e7662f8d3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.542015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cec25-1be3-4b1f-8306-9c28ba70d4f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c0322c32dc4d1b8292e7736aea59b9, group_id=092e7e70b9574e8bb0bf7f657bb4da5c, role_id=9ba48b8364e040eb829f7c1e7662f8d3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.543938 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cec25-1be3-4b1f-8306-9c28ba70d4f5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.569518 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff2415-0eab-47fa-99ff-60f6ff4fffd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.570534 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff2415-0eab-47fa-99ff-60f6ff4fffd3 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.570883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff2415-0eab-47fa-99ff-60f6ff4fffd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.571224 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff2415-0eab-47fa-99ff-60f6ff4fffd3 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9/groups/092e7e70b9574e8bb0bf7f657bb4da5c/roles/997ba13b80634887b0a7e88cbf2b2e62` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.573272 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff2415-0eab-47fa-99ff-60f6ff4fffd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c0322c32dc4d1b8292e7736aea59b9, group_id=092e7e70b9574e8bb0bf7f657bb4da5c, role_id=997ba13b80634887b0a7e88cbf2b2e62)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.574810 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff2415-0eab-47fa-99ff-60f6ff4fffd3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.629885 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 200/410] 10.222.0.43 () {58 vars in 1442 bytes} [Wed May 25 13:51:15 2022] PUT /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9/groups/092e7e70b9574e8bb0bf7f657bb4da5c/roles/9ba48b8364e040eb829f7c1e7662f8d3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:15.631086 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cec25-1be3-4b1f-8306-9c28ba70d4f5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.674614 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 211/411] 10.222.0.43 () {58 vars in 1442 bytes} [Wed May 25 13:51:15 2022] PUT /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9/groups/092e7e70b9574e8bb0bf7f657bb4da5c/roles/997ba13b80634887b0a7e88cbf2b2e62 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:15.741713 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:15.760786 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cec25-1be3-4b1f-8306-9c28ba70d4f5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.806616 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1579318-2066-460a-b4fe-007666f57be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.807656 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1579318-2066-460a-b4fe-007666f57be8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.808141 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1579318-2066-460a-b4fe-007666f57be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.808589 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1579318-2066-460a-b4fe-007666f57be8 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.809536 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1579318-2066-460a-b4fe-007666f57be8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:15.815355 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1579318-2066-460a-b4fe-007666f57be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.815355 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1579318-2066-460a-b4fe-007666f57be8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.822621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 201/412] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:15.828825 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff2415-0eab-47fa-99ff-60f6ff4fffd3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.851759 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b04db-6f6e-4c46-9424-4bbe8fbe8b39 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.852423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b04db-6f6e-4c46-9424-4bbe8fbe8b39 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.852879 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b04db-6f6e-4c46-9424-4bbe8fbe8b39 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.854905 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 202/413] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:51:15.861177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd58136-d87a-4aa1-af02-73b38b404f7d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.861726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd58136-d87a-4aa1-af02-73b38b404f7d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.862206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd58136-d87a-4aa1-af02-73b38b404f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.900149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6bd58136-d87a-4aa1-af02-73b38b404f7d None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:15.901679 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6bd58136-d87a-4aa1-af02-73b38b404f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:15.995213 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff2415-0eab-47fa-99ff-60f6ff4fffd3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:16.004817 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:16.014812 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 203/414] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:51:16.044320 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda375d9-f919-4a78-a337-e47f3124e898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:16.044601 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd58136-d87a-4aa1-af02-73b38b404f7d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:16.045564 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda375d9-f919-4a78-a337-e47f3124e898 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.046005 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda375d9-f919-4a78-a337-e47f3124e898 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.046432 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda375d9-f919-4a78-a337-e47f3124e898 None admin] PATH_INFO: `/v3/groups/1993614fc44140418c2408dee7b693e0` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.048662 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda375d9-f919-4a78-a337-e47f3124e898 None admin] RBAC: Authorizing `identity:get_group(group_id=1993614fc44140418c2408dee7b693e0)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:16.050926 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda375d9-f919-4a78-a337-e47f3124e898 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:16.053777 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 212/415] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:15 2022] GET /identity/v3/groups/1993614fc44140418c2408dee7b693e0 => generated 229 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:16.060944 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda375d9-f919-4a78-a337-e47f3124e898 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:16.145371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:16.167020 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda375d9-f919-4a78-a337-e47f3124e898 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:16.203327 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1e685-3e1b-4327-85d5-dfb62a56b974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:16.204512 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1e685-3e1b-4327-85d5-dfb62a56b974 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.204934 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1e685-3e1b-4327-85d5-dfb62a56b974 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.205045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd58136-d87a-4aa1-af02-73b38b404f7d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:16.205477 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1e685-3e1b-4327-85d5-dfb62a56b974 None admin] PATH_INFO: `/v3/projects/8a4f621a835a4791ab184efa095e7a24` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.206850 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1e685-3e1b-4327-85d5-dfb62a56b974 None admin] RBAC: Authorizing `identity:get_project(project_id=8a4f621a835a4791ab184efa095e7a24)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:16.208617 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1e685-3e1b-4327-85d5-dfb62a56b974 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:16.210818 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 213/416] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:16 2022] GET /identity/v3/projects/8a4f621a835a4791ab184efa095e7a24 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:16.217190 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1e685-3e1b-4327-85d5-dfb62a56b974 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:16.304249 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147077ca-b235-4110-b602-9c9553008488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:16.305673 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147077ca-b235-4110-b602-9c9553008488 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.306128 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147077ca-b235-4110-b602-9c9553008488 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.306609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147077ca-b235-4110-b602-9c9553008488 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.322353 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:16.332575 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147077ca-b235-4110-b602-9c9553008488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-147077ca-b235-4110-b602-9c9553008488 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:16.350315 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:16.351260 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:16.352082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:16.352082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:16.352082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:16.352082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:16.352082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:16.352082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:16.352082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:16.352082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:16.352082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:16.352082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:16.352082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:16.352082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:16.357839 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 204/417] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:16.360814 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147077ca-b235-4110-b602-9c9553008488 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:16.429051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1e685-3e1b-4327-85d5-dfb62a56b974 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:16.471602 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe6a2a-984a-4f92-8076-343e8b7952b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:16.475042 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6a2a-984a-4f92-8076-343e8b7952b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.475519 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6a2a-984a-4f92-8076-343e8b7952b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.478635 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6a2a-984a-4f92-8076-343e8b7952b2 None admin] PATH_INFO: `/v3/projects/8a4f621a835a4791ab184efa095e7a24/groups/1993614fc44140418c2408dee7b693e0/roles/cc4e2e441e3a4f67a7b4ed50677ecaa5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.478635 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe6a2a-984a-4f92-8076-343e8b7952b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a4f621a835a4791ab184efa095e7a24, group_id=1993614fc44140418c2408dee7b693e0, role_id=cc4e2e441e3a4f67a7b4ed50677ecaa5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:16.479990 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe6a2a-984a-4f92-8076-343e8b7952b2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:16.512114 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147077ca-b235-4110-b602-9c9553008488 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:16.549020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cdfc3-b89a-4c70-928e-de234a5ee6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:16.549616 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cdfc3-b89a-4c70-928e-de234a5ee6aa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.549904 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cdfc3-b89a-4c70-928e-de234a5ee6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.550185 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cdfc3-b89a-4c70-928e-de234a5ee6aa None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.551731 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cdfc3-b89a-4c70-928e-de234a5ee6aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:16.552058 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cdfc3-b89a-4c70-928e-de234a5ee6aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:16.553446 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cdfc3-b89a-4c70-928e-de234a5ee6aa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:16.559278 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:16.563950 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 205/418] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:51:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:16.565002 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727a0d6-6453-49fe-ab3d-90fabcb3db92 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.565307 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727a0d6-6453-49fe-ab3d-90fabcb3db92 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.565607 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727a0d6-6453-49fe-ab3d-90fabcb3db92 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.567505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 206/419] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:16.572357 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727a0d6-6453-49fe-ab3d-90fabcb3db92 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:16.574987 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 214/420] 10.222.0.43 () {58 vars in 1442 bytes} [Wed May 25 13:51:16 2022] PUT /identity/v3/projects/8a4f621a835a4791ab184efa095e7a24/groups/1993614fc44140418c2408dee7b693e0/roles/cc4e2e441e3a4f67a7b4ed50677ecaa5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:16.579357 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b4c0c-3e57-4d1a-88b9-90a35c118ade None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.585004 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b4c0c-3e57-4d1a-88b9-90a35c118ade None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.585004 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b4c0c-3e57-4d1a-88b9-90a35c118ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.618260 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1c8b4c0c-3e57-4d1a-88b9-90a35c118ade None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:16.619517 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1c8b4c0c-3e57-4d1a-88b9-90a35c118ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:16.776144 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 215/421] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:16.793673 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727a0d6-6453-49fe-ab3d-90fabcb3db92 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:16.827834 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b4c0c-3e57-4d1a-88b9-90a35c118ade None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:16.855564 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862a08e-1bae-47f3-98af-3d510ffca374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:16.856547 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a08e-1bae-47f3-98af-3d510ffca374 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.857005 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a08e-1bae-47f3-98af-3d510ffca374 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.857908 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a08e-1bae-47f3-98af-3d510ffca374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.868479 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:16.951036 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b4c0c-3e57-4d1a-88b9-90a35c118ade None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.003013 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:17.007422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862a08e-1bae-47f3-98af-3d510ffca374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.008928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862a08e-1bae-47f3-98af-3d510ffca374 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.029513 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0630f-9820-4e98-a28d-fdd37cae68fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.030543 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0630f-9820-4e98-a28d-fdd37cae68fd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.030830 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0630f-9820-4e98-a28d-fdd37cae68fd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.031105 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0630f-9820-4e98-a28d-fdd37cae68fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.053521 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0630f-9820-4e98-a28d-fdd37cae68fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-62d0630f-9820-4e98-a28d-fdd37cae68fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:17.061615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:17.062556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:17.063338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:17.063338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:17.063338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:17.063338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:17.063338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:17.063338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:17.063338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:17.063338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:17.063338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:17.063338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:17.063338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:51:17.063338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:17.079623 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 216/422] 10.222.0.43 () {56 vars in 1114 bytes} [Wed May 25 13:51:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:17.085235 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0630f-9820-4e98-a28d-fdd37cae68fd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.214952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 207/423] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:17.220164 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862a08e-1bae-47f3-98af-3d510ffca374 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.244200 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:17.260205 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0630f-9820-4e98-a28d-fdd37cae68fd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.325738 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e7d76-a45a-4707-b77a-ed073c50187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.326409 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e7d76-a45a-4707-b77a-ed073c50187b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.326694 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e7d76-a45a-4707-b77a-ed073c50187b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.326968 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e7d76-a45a-4707-b77a-ed073c50187b None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.327731 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e7d76-a45a-4707-b77a-ed073c50187b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:17.328039 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e7d76-a45a-4707-b77a-ed073c50187b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.329442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e7d76-a45a-4707-b77a-ed073c50187b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.348133 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 217/424] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:17.356691 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e7d76-a45a-4707-b77a-ed073c50187b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.364395 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862a08e-1bae-47f3-98af-3d510ffca374 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.369429 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:17.440421 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e883020-ccf4-4b28-855b-68fc7887eed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.441856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e883020-ccf4-4b28-855b-68fc7887eed1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.442143 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e883020-ccf4-4b28-855b-68fc7887eed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.442503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e883020-ccf4-4b28-855b-68fc7887eed1 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.443744 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e883020-ccf4-4b28-855b-68fc7887eed1 None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.445190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e883020-ccf4-4b28-855b-68fc7887eed1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.447206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 208/425] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:17 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:17.452102 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e883020-ccf4-4b28-855b-68fc7887eed1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.520519 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e7d76-a45a-4707-b77a-ed073c50187b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.582586 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3c631-f156-4657-b4bd-7e0db103db3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.583803 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3c631-f156-4657-b4bd-7e0db103db3e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.585603 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3c631-f156-4657-b4bd-7e0db103db3e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.586078 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3c631-f156-4657-b4bd-7e0db103db3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.633616 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:17.646403 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e883020-ccf4-4b28-855b-68fc7887eed1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.713592 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3c631-f156-4657-b4bd-7e0db103db3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.714994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f287fbe-490e-4cda-9e00-0d95c8281887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.716751 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3c631-f156-4657-b4bd-7e0db103db3e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.717793 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f287fbe-490e-4cda-9e00-0d95c8281887 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.720060 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f287fbe-490e-4cda-9e00-0d95c8281887 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.720519 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f287fbe-490e-4cda-9e00-0d95c8281887 None admin] PATH_INFO: `/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.721953 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f287fbe-490e-4cda-9e00-0d95c8281887 None admin] RBAC: Authorizing `identity:get_group(group_id=092e7e70b9574e8bb0bf7f657bb4da5c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.724693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f287fbe-490e-4cda-9e00-0d95c8281887 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.727025 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 209/426] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:17 2022] GET /identity/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:17.732590 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f287fbe-490e-4cda-9e00-0d95c8281887 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.806448 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:17.867393 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f287fbe-490e-4cda-9e00-0d95c8281887 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.905058 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907733f-b9e8-4796-9759-aae217e5e934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.906073 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907733f-b9e8-4796-9759-aae217e5e934 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.906596 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907733f-b9e8-4796-9759-aae217e5e934 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.907063 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907733f-b9e8-4796-9759-aae217e5e934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.908124 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907733f-b9e8-4796-9759-aae217e5e934 None admin] RBAC: Adding query filter params (group.id=092e7e70b9574e8bb0bf7f657bb4da5c, role.id=997ba13b80634887b0a7e88cbf2b2e62, scope.project.id=66a86bd19c83439885fcd12d7fb788d3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:17.908646 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907733f-b9e8-4796-9759-aae217e5e934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.910435 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907733f-b9e8-4796-9759-aae217e5e934 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.917306 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 210/427] 10.222.0.43 () {56 vars in 1376 bytes} [Wed May 25 13:51:17 2022] GET /identity/v3/role_assignments?group.id=092e7e70b9574e8bb0bf7f657bb4da5c&scope.project.id=66a86bd19c83439885fcd12d7fb788d3&role.id=997ba13b80634887b0a7e88cbf2b2e62 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:17.938199 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 218/428] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:17.945118 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907733f-b9e8-4796-9759-aae217e5e934 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:18.085467 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907733f-b9e8-4796-9759-aae217e5e934 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:18.088067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:18.124910 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202c6b7-f24a-45be-a5e5-09afec764376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:18.126136 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202c6b7-f24a-45be-a5e5-09afec764376 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.126616 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202c6b7-f24a-45be-a5e5-09afec764376 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.127108 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202c6b7-f24a-45be-a5e5-09afec764376 None admin] PATH_INFO: `/v3/projects/66a86bd19c83439885fcd12d7fb788d3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.129111 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202c6b7-f24a-45be-a5e5-09afec764376 None admin] RBAC: Authorizing `identity:get_project(project_id=66a86bd19c83439885fcd12d7fb788d3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:18.130820 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202c6b7-f24a-45be-a5e5-09afec764376 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:18.133126 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 211/429] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:17 2022] GET /identity/v3/projects/66a86bd19c83439885fcd12d7fb788d3 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:18.139855 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3c631-f156-4657-b4bd-7e0db103db3e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:18.204056 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:18.263144 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3c631-f156-4657-b4bd-7e0db103db3e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:18.308765 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef120a2-3ea4-407b-a72d-6a1eab2fa37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:18.309639 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef120a2-3ea4-407b-a72d-6a1eab2fa37f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.309921 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef120a2-3ea4-407b-a72d-6a1eab2fa37f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.310195 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef120a2-3ea4-407b-a72d-6a1eab2fa37f None admin] PATH_INFO: `/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.313437 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef120a2-3ea4-407b-a72d-6a1eab2fa37f None admin] RBAC: Authorizing `identity:get_group(group_id=092e7e70b9574e8bb0bf7f657bb4da5c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:18.314915 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef120a2-3ea4-407b-a72d-6a1eab2fa37f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:18.317568 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 219/430] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:18 2022] GET /identity/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:18.320417 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ded3e0-90ba-4879-8ff3-147bbe01422c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.320946 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ded3e0-90ba-4879-8ff3-147bbe01422c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.321423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ded3e0-90ba-4879-8ff3-147bbe01422c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.323036 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 212/431] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:18.324380 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef120a2-3ea4-407b-a72d-6a1eab2fa37f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:18.328675 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e0c3f-73a0-48bc-bf5f-58f45fa4c4fe None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.329250 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e0c3f-73a0-48bc-bf5f-58f45fa4c4fe None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.329722 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e0c3f-73a0-48bc-bf5f-58f45fa4c4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.349510 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fd3e0c3f-73a0-48bc-bf5f-58f45fa4c4fe None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:18.351001 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fd3e0c3f-73a0-48bc-bf5f-58f45fa4c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:18.443884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 213/432] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:51:18.445611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb00ee2-8b94-41ab-9a1a-74622a883a08 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.446314 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb00ee2-8b94-41ab-9a1a-74622a883a08 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.446643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb00ee2-8b94-41ab-9a1a-74622a883a08 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.448710 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 214/433] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:18.454382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bca91-6b86-4cc3-8e04-65df3b5f088e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.454611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bca91-6b86-4cc3-8e04-65df3b5f088e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.454895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bca91-6b86-4cc3-8e04-65df3b5f088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.455353 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef120a2-3ea4-407b-a72d-6a1eab2fa37f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:18.476633 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-804bca91-6b86-4cc3-8e04-65df3b5f088e None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:18.478550 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-804bca91-6b86-4cc3-8e04-65df3b5f088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:18.480118 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:18.502710 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af8426-4519-44a9-a703-dfd7eb64be68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:18.503137 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af8426-4519-44a9-a703-dfd7eb64be68 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.503305 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af8426-4519-44a9-a703-dfd7eb64be68 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.503630 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af8426-4519-44a9-a703-dfd7eb64be68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.506724 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af8426-4519-44a9-a703-dfd7eb64be68 None admin] RBAC: Adding query filter params (group.id=092e7e70b9574e8bb0bf7f657bb4da5c, role.id=9ba48b8364e040eb829f7c1e7662f8d3, scope.project.id=66a86bd19c83439885fcd12d7fb788d3) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:18.507042 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af8426-4519-44a9-a703-dfd7eb64be68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:18.508535 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af8426-4519-44a9-a703-dfd7eb64be68 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:18.518018 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 220/434] 10.222.0.43 () {56 vars in 1376 bytes} [Wed May 25 13:51:18 2022] GET /identity/v3/role_assignments?group.id=092e7e70b9574e8bb0bf7f657bb4da5c&scope.project.id=66a86bd19c83439885fcd12d7fb788d3&role.id=9ba48b8364e040eb829f7c1e7662f8d3 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:18.519090 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af8426-4519-44a9-a703-dfd7eb64be68 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:18.572857 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 215/435] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:51:18.605789 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bca91-6b86-4cc3-8e04-65df3b5f088e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:18.650954 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:18.690150 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af8426-4519-44a9-a703-dfd7eb64be68 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:18.754944 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb0cac-ca47-4164-bfaa-223a9d767600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:18.755374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bca91-6b86-4cc3-8e04-65df3b5f088e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:18.755584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb0cac-ca47-4164-bfaa-223a9d767600 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.755894 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb0cac-ca47-4164-bfaa-223a9d767600 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.756173 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb0cac-ca47-4164-bfaa-223a9d767600 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.775047 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb0cac-ca47-4164-bfaa-223a9d767600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-eabb0cac-ca47-4164-bfaa-223a9d767600 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:18.783381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:18.784345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:18.785961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:18.785961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:18.785961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:18.785961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:18.785961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:18.785961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:18.785961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:18.785961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:18.785961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:18.785961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:18.785961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:51:18.785961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:18.788048 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 221/436] 10.222.0.43 () {56 vars in 1114 bytes} [Wed May 25 13:51:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:18.793420 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb0cac-ca47-4164-bfaa-223a9d767600 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:18.807375 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aac31-65db-4d95-80a4-c1d7d9432ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:18.808674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aac31-65db-4d95-80a4-c1d7d9432ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.808814 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aac31-65db-4d95-80a4-c1d7d9432ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.809267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aac31-65db-4d95-80a4-c1d7d9432ca2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.824170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5aac31-65db-4d95-80a4-c1d7d9432ca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4d5aac31-65db-4d95-80a4-c1d7d9432ca2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:18.834734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:18.835748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:18.836567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:18.836567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:18.836567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:18.836567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:18.836567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:18.836567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:18.836567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:18.836567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:18.836567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:18.836567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:18.836567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:51:18.836567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:18.836567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 216/437] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:18.844482 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aac31-65db-4d95-80a4-c1d7d9432ca2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:18.859546 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:18.923273 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb0cac-ca47-4164-bfaa-223a9d767600 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:18.967244 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:18.970299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80168b5-d635-4501-8851-ae008f646b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:18.971357 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80168b5-d635-4501-8851-ae008f646b7c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.971641 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80168b5-d635-4501-8851-ae008f646b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.973309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80168b5-d635-4501-8851-ae008f646b7c None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.973823 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80168b5-d635-4501-8851-ae008f646b7c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:18.975429 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80168b5-d635-4501-8851-ae008f646b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:18.977249 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80168b5-d635-4501-8851-ae008f646b7c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:18.985967 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aac31-65db-4d95-80a4-c1d7d9432ca2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:18.987030 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 222/438] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:18.995463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80168b5-d635-4501-8851-ae008f646b7c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.035325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928e994-d5ab-4f1e-89c9-1f3d5e5d2fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.036160 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928e994-d5ab-4f1e-89c9-1f3d5e5d2fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.036601 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928e994-d5ab-4f1e-89c9-1f3d5e5d2fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.036948 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928e994-d5ab-4f1e-89c9-1f3d5e5d2fb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.037773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928e994-d5ab-4f1e-89c9-1f3d5e5d2fb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:19.038148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928e994-d5ab-4f1e-89c9-1f3d5e5d2fb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.039596 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928e994-d5ab-4f1e-89c9-1f3d5e5d2fb6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.049342 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 217/439] 10.222.0.43 () {56 vars in 1101 bytes} [Wed May 25 13:51:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:19.055436 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928e994-d5ab-4f1e-89c9-1f3d5e5d2fb6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.109611 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80168b5-d635-4501-8851-ae008f646b7c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.118860 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:19.143371 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39f13c-e739-44c3-854f-333f99cb2612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.144291 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39f13c-e739-44c3-854f-333f99cb2612 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.145246 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39f13c-e739-44c3-854f-333f99cb2612 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.145561 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39f13c-e739-44c3-854f-333f99cb2612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.163296 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928e994-d5ab-4f1e-89c9-1f3d5e5d2fb6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.201285 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b66498-3378-4a3b-81cb-a6b44f1c5b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.201943 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b66498-3378-4a3b-81cb-a6b44f1c5b9a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.202226 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b66498-3378-4a3b-81cb-a6b44f1c5b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.202533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b66498-3378-4a3b-81cb-a6b44f1c5b9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.215197 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39f13c-e739-44c3-854f-333f99cb2612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.216697 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39f13c-e739-44c3-854f-333f99cb2612 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.222327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:19.271871 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b66498-3378-4a3b-81cb-a6b44f1c5b9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.273352 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b66498-3378-4a3b-81cb-a6b44f1c5b9a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.319820 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 223/440] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:19.321158 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df0aa-e375-47df-af08-deaf858ecc5f None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.321450 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df0aa-e375-47df-af08-deaf858ecc5f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.321735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df0aa-e375-47df-af08-deaf858ecc5f None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.322988 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 224/441] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:19.327665 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df0aa-e375-47df-af08-deaf858ecc5f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.338179 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:19.379980 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 218/442] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:51:19.381265 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012f89f-ce2a-4b33-934c-020ff581b864 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.381627 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012f89f-ce2a-4b33-934c-020ff581b864 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.381913 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012f89f-ce2a-4b33-934c-020ff581b864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.399589 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3012f89f-ce2a-4b33-934c-020ff581b864 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:19.400781 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3012f89f-ce2a-4b33-934c-020ff581b864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:19.430880 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df0aa-e375-47df-af08-deaf858ecc5f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.447393 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:19.465351 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c68576-2880-49f9-9503-9538d364e246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.466209 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c68576-2880-49f9-9503-9538d364e246 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.466493 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c68576-2880-49f9-9503-9538d364e246 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.466766 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c68576-2880-49f9-9503-9538d364e246 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.467761 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 219/443] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:19.467959 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c68576-2880-49f9-9503-9538d364e246 None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.468687 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012f89f-ce2a-4b33-934c-020ff581b864 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.469425 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c68576-2880-49f9-9503-9538d364e246 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.471254 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 225/444] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:19 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:19.476429 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c68576-2880-49f9-9503-9538d364e246 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.558984 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:19.575082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012f89f-ce2a-4b33-934c-020ff581b864 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.580711 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c68576-2880-49f9-9503-9538d364e246 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.616437 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68982dd5-2bc8-4bdf-b90e-de063b3b2263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.616636 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a90e2-fee9-44a1-9225-586d7e11ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.617295 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68982dd5-2bc8-4bdf-b90e-de063b3b2263 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.617399 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a90e2-fee9-44a1-9225-586d7e11ba92 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.617578 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68982dd5-2bc8-4bdf-b90e-de063b3b2263 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.617676 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a90e2-fee9-44a1-9225-586d7e11ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.617850 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a90e2-fee9-44a1-9225-586d7e11ba92 None admin] PATH_INFO: `/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.617955 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68982dd5-2bc8-4bdf-b90e-de063b3b2263 None admin] PATH_INFO: `/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.619012 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68982dd5-2bc8-4bdf-b90e-de063b3b2263 None admin] RBAC: Authorizing `identity:get_group(group_id=092e7e70b9574e8bb0bf7f657bb4da5c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.619120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a90e2-fee9-44a1-9225-586d7e11ba92 None admin] RBAC: Authorizing `identity:get_project(project_id=b7c0322c32dc4d1b8292e7736aea59b9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.620478 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a90e2-fee9-44a1-9225-586d7e11ba92 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.620587 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68982dd5-2bc8-4bdf-b90e-de063b3b2263 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.622156 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 220/445] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:19 2022] GET /identity/v3/projects/b7c0322c32dc4d1b8292e7736aea59b9 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:19.627428 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 226/446] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:19 2022] GET /identity/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:19.627588 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a90e2-fee9-44a1-9225-586d7e11ba92 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.628282 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68982dd5-2bc8-4bdf-b90e-de063b3b2263 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.673677 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:19.726220 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a90e2-fee9-44a1-9225-586d7e11ba92 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.728467 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68982dd5-2bc8-4bdf-b90e-de063b3b2263 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.760432 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e347a-7f41-4c5f-8d86-9009b8407717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.761218 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e347a-7f41-4c5f-8d86-9009b8407717 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.761497 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e347a-7f41-4c5f-8d86-9009b8407717 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.761764 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e347a-7f41-4c5f-8d86-9009b8407717 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.765023 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f0172-df07-4c05-a784-792ab0758d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.765872 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f0172-df07-4c05-a784-792ab0758d94 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.766154 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f0172-df07-4c05-a784-792ab0758d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.766430 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f0172-df07-4c05-a784-792ab0758d94 None admin] PATH_INFO: `/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.767593 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f0172-df07-4c05-a784-792ab0758d94 None admin] RBAC: Authorizing `identity:get_group(group_id=092e7e70b9574e8bb0bf7f657bb4da5c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.769128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f0172-df07-4c05-a784-792ab0758d94 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.770893 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 227/447] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:19 2022] GET /identity/v3/groups/092e7e70b9574e8bb0bf7f657bb4da5c => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:19.771643 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f0172-df07-4c05-a784-792ab0758d94 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.771925 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e347a-7f41-4c5f-8d86-9009b8407717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2e4e347a-7f41-4c5f-8d86-9009b8407717 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:19.779634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:19.780571 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:19.781363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:19.781363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:19.781363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:19.781363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:19.781363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:19.781363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:19.781363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:19.781363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:19.781363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:19.781363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:19.781363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:51:19.781363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:19.781363 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 221/448] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:51:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:19.782051 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e347a-7f41-4c5f-8d86-9009b8407717 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.790351 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:19.875989 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f0172-df07-4c05-a784-792ab0758d94 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.888957 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e347a-7f41-4c5f-8d86-9009b8407717 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.898970 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:19.912355 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c967bc-e1af-45e4-80eb-243689288248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.913014 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c967bc-e1af-45e4-80eb-243689288248 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.913296 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c967bc-e1af-45e4-80eb-243689288248 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.914696 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c967bc-e1af-45e4-80eb-243689288248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.914696 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c967bc-e1af-45e4-80eb-243689288248 None admin] RBAC: Adding query filter params (group.id=092e7e70b9574e8bb0bf7f657bb4da5c, role.id=9ba48b8364e040eb829f7c1e7662f8d3, scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:19.914696 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c967bc-e1af-45e4-80eb-243689288248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.916150 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c967bc-e1af-45e4-80eb-243689288248 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.935979 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 228/449] 10.222.0.43 () {56 vars in 1376 bytes} [Wed May 25 13:51:19 2022] GET /identity/v3/role_assignments?group.id=092e7e70b9574e8bb0bf7f657bb4da5c&scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9&role.id=9ba48b8364e040eb829f7c1e7662f8d3 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:19.935979 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c967bc-e1af-45e4-80eb-243689288248 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.936293 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4276f32-a037-4d28-82bd-fed0f7fea8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.936293 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4276f32-a037-4d28-82bd-fed0f7fea8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.936293 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4276f32-a037-4d28-82bd-fed0f7fea8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.936293 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4276f32-a037-4d28-82bd-fed0f7fea8f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.936606 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4276f32-a037-4d28-82bd-fed0f7fea8f1 None admin] RBAC: Adding query filter params (group.id=092e7e70b9574e8bb0bf7f657bb4da5c, role.id=997ba13b80634887b0a7e88cbf2b2e62, scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:19.936606 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4276f32-a037-4d28-82bd-fed0f7fea8f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.936606 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4276f32-a037-4d28-82bd-fed0f7fea8f1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.943038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 222/450] 10.222.0.43 () {56 vars in 1376 bytes} [Wed May 25 13:51:19 2022] GET /identity/v3/role_assignments?group.id=092e7e70b9574e8bb0bf7f657bb4da5c&scope.project.id=b7c0322c32dc4d1b8292e7736aea59b9&role.id=997ba13b80634887b0a7e88cbf2b2e62 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:20.021614 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:20.048827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c967bc-e1af-45e4-80eb-243689288248 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:20.088815 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38147-f7ff-4951-9432-0083ead57ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:20.089867 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38147-f7ff-4951-9432-0083ead57ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:20.090160 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38147-f7ff-4951-9432-0083ead57ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:20.090440 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38147-f7ff-4951-9432-0083ead57ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:20.091244 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f38147-f7ff-4951-9432-0083ead57ae3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:20.091559 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f38147-f7ff-4951-9432-0083ead57ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:20.093085 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f38147-f7ff-4951-9432-0083ead57ae3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:20.107574 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 229/451] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:20.109320 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4276f32-a037-4d28-82bd-fed0f7fea8f1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:20.225943 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4276f32-a037-4d28-82bd-fed0f7fea8f1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:20.260611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0b57d-4a7d-4a8e-a86c-d56cff71f566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:20.261265 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0b57d-4a7d-4a8e-a86c-d56cff71f566 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:20.261550 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0b57d-4a7d-4a8e-a86c-d56cff71f566 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:20.261825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0b57d-4a7d-4a8e-a86c-d56cff71f566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:20.305173 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:20.333623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0b57d-4a7d-4a8e-a86c-d56cff71f566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:20.335106 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0b57d-4a7d-4a8e-a86c-d56cff71f566 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:20.435508 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 223/452] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:20.441773 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38147-f7ff-4951-9432-0083ead57ae3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:20.544582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38147-f7ff-4951-9432-0083ead57ae3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:20.576883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f691570-c404-4190-86e1-5129fe25b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:20.577734 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f691570-c404-4190-86e1-5129fe25b781 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:20.578015 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f691570-c404-4190-86e1-5129fe25b781 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:20.578288 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f691570-c404-4190-86e1-5129fe25b781 None admin] PATH_INFO: `/v3/projects/8a4f621a835a4791ab184efa095e7a24` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:20.579444 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f691570-c404-4190-86e1-5129fe25b781 None admin] RBAC: Authorizing `identity:get_project(project_id=8a4f621a835a4791ab184efa095e7a24)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:20.580922 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f691570-c404-4190-86e1-5129fe25b781 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:20.583443 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 230/453] 10.222.0.43 () {56 vars in 1186 bytes} [Wed May 25 13:51:20 2022] GET /identity/v3/projects/8a4f621a835a4791ab184efa095e7a24 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:20.588948 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0b57d-4a7d-4a8e-a86c-d56cff71f566 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:20.659437 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:20.689679 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0b57d-4a7d-4a8e-a86c-d56cff71f566 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:20.724111 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847a03f-6615-4431-9bb4-3395b75e96c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:20.724949 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847a03f-6615-4431-9bb4-3395b75e96c0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:20.725229 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847a03f-6615-4431-9bb4-3395b75e96c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:20.725505 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847a03f-6615-4431-9bb4-3395b75e96c0 None admin] PATH_INFO: `/v3/groups/1993614fc44140418c2408dee7b693e0` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:20.726656 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847a03f-6615-4431-9bb4-3395b75e96c0 None admin] RBAC: Authorizing `identity:get_group(group_id=1993614fc44140418c2408dee7b693e0)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:20.728137 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847a03f-6615-4431-9bb4-3395b75e96c0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:20.729740 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 224/454] 10.222.0.43 () {56 vars in 1180 bytes} [Wed May 25 13:51:20 2022] GET /identity/v3/groups/1993614fc44140418c2408dee7b693e0 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:20.735457 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f691570-c404-4190-86e1-5129fe25b781 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:20.744643 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:20.836710 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f691570-c404-4190-86e1-5129fe25b781 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:20.869946 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5b207-ef0d-4de3-97e2-97c0e1ddf0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:20.870591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b207-ef0d-4de3-97e2-97c0e1ddf0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:20.870880 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b207-ef0d-4de3-97e2-97c0e1ddf0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:20.871158 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b207-ef0d-4de3-97e2-97c0e1ddf0d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:20.872014 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5b207-ef0d-4de3-97e2-97c0e1ddf0d3 None admin] RBAC: Adding query filter params (group.id=1993614fc44140418c2408dee7b693e0, role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5, scope.project.id=8a4f621a835a4791ab184efa095e7a24) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:20.872331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5b207-ef0d-4de3-97e2-97c0e1ddf0d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:20.873774 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5b207-ef0d-4de3-97e2-97c0e1ddf0d3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:20.879919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 231/455] 10.222.0.43 () {56 vars in 1376 bytes} [Wed May 25 13:51:20 2022] GET /identity/v3/role_assignments?group.id=1993614fc44140418c2408dee7b693e0&scope.project.id=8a4f621a835a4791ab184efa095e7a24&role.id=cc4e2e441e3a4f67a7b4ed50677ecaa5 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:23.445371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70228d70-90c7-4714-917c-f3b8e11d20bd None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:23.446252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70228d70-90c7-4714-917c-f3b8e11d20bd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:23.446668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70228d70-90c7-4714-917c-f3b8e11d20bd None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:23.448216 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 225/456] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:23.453377 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72b5a0-afcb-46ee-8585-61453acd184d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:23.454103 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72b5a0-afcb-46ee-8585-61453acd184d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:23.454543 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72b5a0-afcb-46ee-8585-61453acd184d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:23.476706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2a72b5a0-afcb-46ee-8585-61453acd184d None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:23.478102 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2a72b5a0-afcb-46ee-8585-61453acd184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:23.565284 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:23.574261 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 232/457] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:23.615368 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70228d70-90c7-4714-917c-f3b8e11d20bd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:23.760634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70228d70-90c7-4714-917c-f3b8e11d20bd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:23.814325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47673597-a4a7-4bb5-90c0-d6c70d3c11a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:23.814325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47673597-a4a7-4bb5-90c0-d6c70d3c11a0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:23.814325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47673597-a4a7-4bb5-90c0-d6c70d3c11a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:23.814325 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47673597-a4a7-4bb5-90c0-d6c70d3c11a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:23.827827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47673597-a4a7-4bb5-90c0-d6c70d3c11a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:23.829608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47673597-a4a7-4bb5-90c0-d6c70d3c11a0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:23.856019 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-47673597-a4a7-4bb5-90c0-d6c70d3c11a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:23.857344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:23.858167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:23.859000 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:23.859000 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:23.859000 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:23.859000 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:23.860907 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 226/458] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:23.868902 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72b5a0-afcb-46ee-8585-61453acd184d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:23.885030 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6faa21f-ea44-4fa5-814f-8ffd4e24b768 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:23.885734 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6faa21f-ea44-4fa5-814f-8ffd4e24b768 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:23.886244 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6faa21f-ea44-4fa5-814f-8ffd4e24b768 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:23.888410 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 227/459] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:23.908915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a088bd-c6a9-4283-b520-8e1dbf168d60 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:23.910110 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a088bd-c6a9-4283-b520-8e1dbf168d60 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:23.910638 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a088bd-c6a9-4283-b520-8e1dbf168d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:23.941669 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-08a088bd-c6a9-4283-b520-8e1dbf168d60 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:23.943310 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-08a088bd-c6a9-4283-b520-8e1dbf168d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:23.989926 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72b5a0-afcb-46ee-8585-61453acd184d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:24.022335 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 228/460] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:51:24.024139 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393e503-28ab-45c0-8294-8a810be87f58 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:24.024656 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393e503-28ab-45c0-8294-8a810be87f58 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:24.025133 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393e503-28ab-45c0-8294-8a810be87f58 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:24.031353 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 229/461] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:24.033622 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf26dd-ddf7-41f7-9474-f189fdd7204e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:24.034212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf26dd-ddf7-41f7-9474-f189fdd7204e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:24.035779 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf26dd-ddf7-41f7-9474-f189fdd7204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:24.041522 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105cdb1-c258-4e13-a0b5-e9296abee6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:24.043324 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105cdb1-c258-4e13-a0b5-e9296abee6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:24.044574 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105cdb1-c258-4e13-a0b5-e9296abee6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:24.046321 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105cdb1-c258-4e13-a0b5-e9296abee6d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:24.047359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105cdb1-c258-4e13-a0b5-e9296abee6d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:24.047906 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105cdb1-c258-4e13-a0b5-e9296abee6d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:24.049537 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105cdb1-c258-4e13-a0b5-e9296abee6d2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:24.062422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-75bf26dd-ddf7-41f7-9474-f189fdd7204e None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:24.063651 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-75bf26dd-ddf7-41f7-9474-f189fdd7204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:24.065141 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 233/462] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:24.067144 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105cdb1-c258-4e13-a0b5-e9296abee6d2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:24.146494 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:24.146812 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 230/463] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:24.148371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf26dd-ddf7-41f7-9474-f189fdd7204e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:24.204630 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105cdb1-c258-4e13-a0b5-e9296abee6d2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:24.221667 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:24.249919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e0391-b54b-4fa5-a325-4e7842da862b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:24.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e0391-b54b-4fa5-a325-4e7842da862b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:24.251618 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e0391-b54b-4fa5-a325-4e7842da862b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:24.252474 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e0391-b54b-4fa5-a325-4e7842da862b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:24.266542 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e0391-b54b-4fa5-a325-4e7842da862b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:24.268033 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e0391-b54b-4fa5-a325-4e7842da862b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:24.278174 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf26dd-ddf7-41f7-9474-f189fdd7204e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-6b4e0391-b54b-4fa5-a325-4e7842da862b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:24.290582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:24.291463 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:24.292363 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:24.292363 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:24.292363 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:24.292363 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:24.294455 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 234/464] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:24.295881 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e0391-b54b-4fa5-a325-4e7842da862b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:24.319100 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351c4cd-cc8a-4bcc-8b30-4e5f96d53af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:24.319871 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351c4cd-cc8a-4bcc-8b30-4e5f96d53af5 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:24.320219 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351c4cd-cc8a-4bcc-8b30-4e5f96d53af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:24.320561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351c4cd-cc8a-4bcc-8b30-4e5f96d53af5 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:24.321324 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351c4cd-cc8a-4bcc-8b30-4e5f96d53af5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:24.322836 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351c4cd-cc8a-4bcc-8b30-4e5f96d53af5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:24.401730 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e0391-b54b-4fa5-a325-4e7842da862b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:24.415184 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:24.428679 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 231/465] 10.222.0.43 () {60 vars in 1132 bytes} [Wed May 25 13:51:24 2022] POST /identity/v3/users => generated 246 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:24.429997 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e9320-a87b-4e33-a7ba-a3b02e9b5cd4 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:24.430454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e9320-a87b-4e33-a7ba-a3b02e9b5cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:24.430738 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e9320-a87b-4e33-a7ba-a3b02e9b5cd4 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:24.432001 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 232/466] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:24.432874 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e9320-a87b-4e33-a7ba-a3b02e9b5cd4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:24.443509 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e19502-b063-495a-a41c-d420d463cf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:24.444414 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e19502-b063-495a-a41c-d420d463cf43 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:24.444694 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e19502-b063-495a-a41c-d420d463cf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:24.445072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e19502-b063-495a-a41c-d420d463cf43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:24.464423 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e19502-b063-495a-a41c-d420d463cf43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:24.466032 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e19502-b063-495a-a41c-d420d463cf43 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-34e19502-b063-495a-a41c-d420d463cf43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:24.493687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:24.494659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:24.496322 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:24.496322 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:24.496322 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:24.496322 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:24.496322 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 235/467] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:24.496767 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40c7c4-e03e-451a-bdde-f212d4f6e640 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:24.497005 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40c7c4-e03e-451a-bdde-f212d4f6e640 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:24.497286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40c7c4-e03e-451a-bdde-f212d4f6e640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:24.519547 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-be40c7c4-e03e-451a-bdde-f212d4f6e640 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:24.521296 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-be40c7c4-e03e-451a-bdde-f212d4f6e640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:24.586150 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e9320-a87b-4e33-a7ba-a3b02e9b5cd4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:24.598118 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:24.602091 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 236/468] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:24.603406 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40c7c4-e03e-451a-bdde-f212d4f6e640 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:24.661035 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeefc4-9ecf-44e7-bc7c-9ab631fe15b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:24.661621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeefc4-9ecf-44e7-bc7c-9ab631fe15b8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:24.662049 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeefc4-9ecf-44e7-bc7c-9ab631fe15b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:24.662338 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeefc4-9ecf-44e7-bc7c-9ab631fe15b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:24.663075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeefc4-9ecf-44e7-bc7c-9ab631fe15b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:24.663388 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeefc4-9ecf-44e7-bc7c-9ab631fe15b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:24.664869 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeefc4-9ecf-44e7-bc7c-9ab631fe15b8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:24.680518 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 233/469] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:24.681241 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeefc4-9ecf-44e7-bc7c-9ab631fe15b8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:24.730052 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:24.738258 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40c7c4-e03e-451a-bdde-f212d4f6e640 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:24.778100 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f157e-1392-4f9a-95ee-bb43ec432b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:24.778775 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f157e-1392-4f9a-95ee-bb43ec432b35 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:24.779066 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f157e-1392-4f9a-95ee-bb43ec432b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:24.779348 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f157e-1392-4f9a-95ee-bb43ec432b35 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:24.780117 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f157e-1392-4f9a-95ee-bb43ec432b35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:24.780430 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f157e-1392-4f9a-95ee-bb43ec432b35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:24.782270 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f157e-1392-4f9a-95ee-bb43ec432b35 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:24.795028 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 237/470] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:24.795974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f157e-1392-4f9a-95ee-bb43ec432b35 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:24.813750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeefc4-9ecf-44e7-bc7c-9ab631fe15b8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:24.861510 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10114aad-47af-470a-86fe-5928bb50aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:24.862309 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10114aad-47af-470a-86fe-5928bb50aba1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:24.863198 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10114aad-47af-470a-86fe-5928bb50aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:24.863536 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10114aad-47af-470a-86fe-5928bb50aba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:24.874989 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10114aad-47af-470a-86fe-5928bb50aba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:24.876564 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10114aad-47af-470a-86fe-5928bb50aba1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-10114aad-47af-470a-86fe-5928bb50aba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:24.897267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:24.898172 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:24.899009 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:24.899009 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:24.899009 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:24.899009 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:24.903525 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 234/471] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:24.904596 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10114aad-47af-470a-86fe-5928bb50aba1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:24.915316 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f157e-1392-4f9a-95ee-bb43ec432b35 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:24.928926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:24.964825 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a2226-8c85-46d9-b3fb-a7df0dc64f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:24.966099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a2226-8c85-46d9-b3fb-a7df0dc64f08 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:24.966558 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a2226-8c85-46d9-b3fb-a7df0dc64f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:24.967178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a2226-8c85-46d9-b3fb-a7df0dc64f08 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:24.968408 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a2226-8c85-46d9-b3fb-a7df0dc64f08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:24.970479 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a2226-8c85-46d9-b3fb-a7df0dc64f08 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:25.020408 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10114aad-47af-470a-86fe-5928bb50aba1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:25.049185 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 238/472] 10.222.0.43 () {60 vars in 1132 bytes} [Wed May 25 13:51:24 2022] POST /identity/v3/users => generated 248 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:25.051884 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a2226-8c85-46d9-b3fb-a7df0dc64f08 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:25.059049 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca1384-2eb7-49ee-9a97-1be776a73173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:25.059866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca1384-2eb7-49ee-9a97-1be776a73173 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:25.060150 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca1384-2eb7-49ee-9a97-1be776a73173 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:25.060425 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca1384-2eb7-49ee-9a97-1be776a73173 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:25.061147 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca1384-2eb7-49ee-9a97-1be776a73173 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:25.062610 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca1384-2eb7-49ee-9a97-1be776a73173 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:25.072195 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:25.178925 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a2226-8c85-46d9-b3fb-a7df0dc64f08 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:25.183213 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 235/473] 10.222.0.43 () {60 vars in 1132 bytes} [Wed May 25 13:51:24 2022] POST /identity/v3/users => generated 248 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:25.184220 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3d644-464f-455c-a36a-a564e0a17668 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:25.184575 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3d644-464f-455c-a36a-a564e0a17668 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:25.184889 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3d644-464f-455c-a36a-a564e0a17668 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:25.186596 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 236/474] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:25.202584 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668065f2-9b89-4431-bdc7-e3d58c4f4fe1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:25.202914 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668065f2-9b89-4431-bdc7-e3d58c4f4fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:25.203145 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668065f2-9b89-4431-bdc7-e3d58c4f4fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:25.233058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed19f9-92e1-46db-9712-b957ee77c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:25.235350 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed19f9-92e1-46db-9712-b957ee77c57b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:25.236168 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed19f9-92e1-46db-9712-b957ee77c57b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:25.236836 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed19f9-92e1-46db-9712-b957ee77c57b None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:25.239444 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed19f9-92e1-46db-9712-b957ee77c57b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:25.240821 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed19f9-92e1-46db-9712-b957ee77c57b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:25.242439 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed19f9-92e1-46db-9712-b957ee77c57b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:25.247493 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-668065f2-9b89-4431-bdc7-e3d58c4f4fe1 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:25.251747 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-668065f2-9b89-4431-bdc7-e3d58c4f4fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:25.269276 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 239/475] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:25.274975 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed19f9-92e1-46db-9712-b957ee77c57b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:25.344545 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 237/476] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:25.360511 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:25.371344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668065f2-9b89-4431-bdc7-e3d58c4f4fe1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:25.381533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:25.400972 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed19f9-92e1-46db-9712-b957ee77c57b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:25.447829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d491db-4197-4e22-9c43-8e889b9c4808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:25.448457 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d491db-4197-4e22-9c43-8e889b9c4808 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:25.448742 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d491db-4197-4e22-9c43-8e889b9c4808 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:25.449022 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d491db-4197-4e22-9c43-8e889b9c4808 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:25.449776 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d491db-4197-4e22-9c43-8e889b9c4808 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:25.451207 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d491db-4197-4e22-9c43-8e889b9c4808 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:25.501121 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668065f2-9b89-4431-bdc7-e3d58c4f4fe1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:25.541041 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1136e35-3b8e-4811-80ae-ba882ff283df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:25.541705 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1136e35-3b8e-4811-80ae-ba882ff283df None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:25.541987 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1136e35-3b8e-4811-80ae-ba882ff283df None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:25.542262 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1136e35-3b8e-4811-80ae-ba882ff283df None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:25.543006 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1136e35-3b8e-4811-80ae-ba882ff283df None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:25.544401 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1136e35-3b8e-4811-80ae-ba882ff283df None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:25.588403 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.sql.core [None req-a1136e35-3b8e-4811-80ae-ba882ff283df None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 13:51:25.588403 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 13:51:25.588403 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [parameters: {'id': 'f225c30e3e3f453e83ad51058cc3cf0c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 13:51:25.588403 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80398) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a1136e35-3b8e-4811-80ae-ba882ff283df None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application result = self._query(query) May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application conn.query(q) May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application result.read() May 25 13:51:25.604986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return ref.to_dict() May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 13:51:25.605915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application next(self.gen) May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application yield resource May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application next(self.gen) May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.session.rollback() May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.force_reraise() May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise self.value May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application session.commit() May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 13:51:25.606985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._prepare_impl() May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.session.flush() May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._flush(objects) May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application compat.raise_( May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application flush_context.execute() May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rec.execute(self) May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 13:51:25.607856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 13:51:25.608725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application result = self._query(query) May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application conn.query(q) May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application result.read() May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 13:51:25.609531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [parameters: {'id': 'f225c30e3e3f453e83ad51058cc3cf0c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:25.610323 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 13:51:25.611130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:25.616462 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 238/477] 10.222.0.43 () {60 vars in 1131 bytes} [Wed May 25 13:51:25 2022] POST /identity/v3/roles => generated 144 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:25.616462 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1136e35-3b8e-4811-80ae-ba882ff283df None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:25.646941 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 240/478] 10.222.0.43 () {60 vars in 1132 bytes} [Wed May 25 13:51:25 2022] POST /identity/v3/users => generated 249 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:51:25.711622 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:25.747267 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1136e35-3b8e-4811-80ae-ba882ff283df None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:25.796162 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc3f6e-6d8e-4315-99fe-1b8c9a5812ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:25.797435 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc3f6e-6d8e-4315-99fe-1b8c9a5812ef None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:25.797931 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc3f6e-6d8e-4315-99fe-1b8c9a5812ef None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:25.798409 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc3f6e-6d8e-4315-99fe-1b8c9a5812ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:25.812393 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc3f6e-6d8e-4315-99fe-1b8c9a5812ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9fbc3f6e-6d8e-4315-99fe-1b8c9a5812ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:25.821563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:25.822503 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:25.823322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:25.823322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:25.823322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:25.823322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:25.823322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:25.823322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:25.823322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:25.823322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:25.823322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:25.823322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:25.823322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:51:25.823322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:25.826197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 239/479] 10.222.0.43 () {56 vars in 1114 bytes} [Wed May 25 13:51:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:25.833387 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d491db-4197-4e22-9c43-8e889b9c4808 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:25.951014 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d491db-4197-4e22-9c43-8e889b9c4808 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:25.978769 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:25.988612 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16965ee-9df0-46d1-8572-20bd6ed39e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:25.989298 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16965ee-9df0-46d1-8572-20bd6ed39e0d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:25.989585 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16965ee-9df0-46d1-8572-20bd6ed39e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:25.989867 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16965ee-9df0-46d1-8572-20bd6ed39e0d None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:25.994468 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16965ee-9df0-46d1-8572-20bd6ed39e0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:25.994468 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16965ee-9df0-46d1-8572-20bd6ed39e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:25.994468 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16965ee-9df0-46d1-8572-20bd6ed39e0d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:26.002324 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 241/480] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:27.273341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2903d-7315-4e4c-9337-1903fb6bf22d None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:27.274100 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2903d-7315-4e4c-9337-1903fb6bf22d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:27.274100 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2903d-7315-4e4c-9337-1903fb6bf22d None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:27.275736 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 240/481] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:27.281234 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf2b0f-6969-4b97-aeff-289ad94fa1fb None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:27.281732 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf2b0f-6969-4b97-aeff-289ad94fa1fb None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:27.281989 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf2b0f-6969-4b97-aeff-289ad94fa1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:27.299657 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b7cf2b0f-6969-4b97-aeff-289ad94fa1fb None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:27.300935 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b7cf2b0f-6969-4b97-aeff-289ad94fa1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:27.384774 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 242/482] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:51:27.421067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2903d-7315-4e4c-9337-1903fb6bf22d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:27.577549 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2903d-7315-4e4c-9337-1903fb6bf22d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:27.617386 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:27.626354 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e7076-c4c9-437a-9932-6e84566454e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:27.627393 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e7076-c4c9-437a-9932-6e84566454e7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:27.627687 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e7076-c4c9-437a-9932-6e84566454e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:27.628053 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e7076-c4c9-437a-9932-6e84566454e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:27.648328 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e7076-c4c9-437a-9932-6e84566454e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-aa6e7076-c4c9-437a-9932-6e84566454e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:27.656469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:27.657422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:27.658206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:27.658206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:27.658206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:27.658206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:27.658206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:27.658206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:27.658206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:27.658206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:27.658206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:27.658206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:27.658206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:27.658206 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:27.660330 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 241/483] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:27.665735 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf2b0f-6969-4b97-aeff-289ad94fa1fb None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:27.707134 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62974346-d1b1-4b1f-a192-4dbefd9b21c5 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:27.707454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62974346-d1b1-4b1f-a192-4dbefd9b21c5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:27.707691 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62974346-d1b1-4b1f-a192-4dbefd9b21c5 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:27.709082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 242/484] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:27.714166 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f6d2b-5e04-48d7-9cdb-4d43f686b16f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:27.714465 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f6d2b-5e04-48d7-9cdb-4d43f686b16f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:27.714745 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f6d2b-5e04-48d7-9cdb-4d43f686b16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:27.743450 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c55f6d2b-5e04-48d7-9cdb-4d43f686b16f None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:27.744859 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c55f6d2b-5e04-48d7-9cdb-4d43f686b16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:27.826732 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 243/485] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:51:27.849384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf2b0f-6969-4b97-aeff-289ad94fa1fb None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:27.870987 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f6d2b-5e04-48d7-9cdb-4d43f686b16f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:27.871923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:27.909850 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45414ea3-19a8-47ed-89ac-61c316c3c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:27.910522 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45414ea3-19a8-47ed-89ac-61c316c3c218 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:27.910899 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45414ea3-19a8-47ed-89ac-61c316c3c218 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:27.911180 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45414ea3-19a8-47ed-89ac-61c316c3c218 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:27.911962 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45414ea3-19a8-47ed-89ac-61c316c3c218 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:27.912270 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45414ea3-19a8-47ed-89ac-61c316c3c218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:27.913651 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45414ea3-19a8-47ed-89ac-61c316c3c218 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:27.931177 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 243/486] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:27.937311 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45414ea3-19a8-47ed-89ac-61c316c3c218 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:27.994344 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f6d2b-5e04-48d7-9cdb-4d43f686b16f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:28.016803 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:28.036388 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2092e-b539-402a-812f-fb8cdcb63377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:28.037558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2092e-b539-402a-812f-fb8cdcb63377 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.042366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2092e-b539-402a-812f-fb8cdcb63377 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.042878 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2092e-b539-402a-812f-fb8cdcb63377 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.060868 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2092e-b539-402a-812f-fb8cdcb63377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b5d2092e-b539-402a-812f-fb8cdcb63377 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:28.069827 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:28.070719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:28.071538 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:28.071538 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:28.071538 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:28.071538 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:28.071538 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:28.071538 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:28.071538 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:28.071538 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:28.071538 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:28.071538 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:28.071538 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:28.071538 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:28.074235 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 244/487] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:28.079691 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2092e-b539-402a-812f-fb8cdcb63377 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:28.152654 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45414ea3-19a8-47ed-89ac-61c316c3c218 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:28.188317 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4387e-3c7f-46c1-863b-a81c47311169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:28.189110 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4387e-3c7f-46c1-863b-a81c47311169 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.189388 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4387e-3c7f-46c1-863b-a81c47311169 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.189658 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4387e-3c7f-46c1-863b-a81c47311169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.202648 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4387e-3c7f-46c1-863b-a81c47311169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:28.204163 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4387e-3c7f-46c1-863b-a81c47311169 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:28.216046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2092e-b539-402a-812f-fb8cdcb63377 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-dbd4387e-3c7f-46c1-863b-a81c47311169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:28.223069 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:28.223974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:28.224822 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:28.224822 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:28.224822 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:28.224822 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:28.224822 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 244/488] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:28.225992 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f335-e5e7-4687-8bf2-8378fcaff9be None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.226276 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f335-e5e7-4687-8bf2-8378fcaff9be None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.226549 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f335-e5e7-4687-8bf2-8378fcaff9be None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.231995 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 245/489] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:28.231995 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90f335-e5e7-4687-8bf2-8378fcaff9be None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:28.264078 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:28.270392 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3dbcf-4822-4a0f-af23-2c7306daaa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:28.272199 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3dbcf-4822-4a0f-af23-2c7306daaa62 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.272590 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3dbcf-4822-4a0f-af23-2c7306daaa62 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.273094 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3dbcf-4822-4a0f-af23-2c7306daaa62 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.274573 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3dbcf-4822-4a0f-af23-2c7306daaa62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:28.275090 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3dbcf-4822-4a0f-af23-2c7306daaa62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:28.276488 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3dbcf-4822-4a0f-af23-2c7306daaa62 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:28.290930 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 245/490] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:28.292507 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a54d4-be1b-4b14-880a-f65d477c64de None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.292717 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a54d4-be1b-4b14-880a-f65d477c64de None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.292981 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a54d4-be1b-4b14-880a-f65d477c64de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.325747 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-076a54d4-be1b-4b14-880a-f65d477c64de None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:28.327145 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-076a54d4-be1b-4b14-880a-f65d477c64de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:28.360039 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90f335-e5e7-4687-8bf2-8378fcaff9be None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:28.375795 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:28.410415 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8160d-0a12-446a-9c5e-37478b4610a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:28.411612 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8160d-0a12-446a-9c5e-37478b4610a3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.412438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8160d-0a12-446a-9c5e-37478b4610a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.413236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8160d-0a12-446a-9c5e-37478b4610a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.414283 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8160d-0a12-446a-9c5e-37478b4610a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:28.414871 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8160d-0a12-446a-9c5e-37478b4610a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:28.416394 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 246/491] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:28.416742 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8160d-0a12-446a-9c5e-37478b4610a3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:28.417366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a54d4-be1b-4b14-880a-f65d477c64de None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:28.431992 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 246/492] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:28.436916 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8160d-0a12-446a-9c5e-37478b4610a3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:28.551890 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a54d4-be1b-4b14-880a-f65d477c64de None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:28.573638 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:28.587885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8160d-0a12-446a-9c5e-37478b4610a3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:28.594134 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf38cb-5246-4f6b-881b-ddfb5dc41701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:28.595218 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf38cb-5246-4f6b-881b-ddfb5dc41701 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.595704 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf38cb-5246-4f6b-881b-ddfb5dc41701 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.596244 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf38cb-5246-4f6b-881b-ddfb5dc41701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.608710 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf38cb-5246-4f6b-881b-ddfb5dc41701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:28.610478 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf38cb-5246-4f6b-881b-ddfb5dc41701 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:28.629270 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07fd79-6717-460e-b1a5-e1e743948e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:28.630062 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07fd79-6717-460e-b1a5-e1e743948e25 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.630341 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07fd79-6717-460e-b1a5-e1e743948e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.630614 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07fd79-6717-460e-b1a5-e1e743948e25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7bcf38cb-5246-4f6b-881b-ddfb5dc41701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:28.631834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:28.632657 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:28.633489 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:28.633489 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:28.633489 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:28.633489 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:28.635821 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 247/493] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:28.636821 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf38cb-5246-4f6b-881b-ddfb5dc41701 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:28.643526 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07fd79-6717-460e-b1a5-e1e743948e25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:28.652116 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07fd79-6717-460e-b1a5-e1e743948e25 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:28.667389 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-de07fd79-6717-460e-b1a5-e1e743948e25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:28.676359 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:28.686649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:28.687669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:28.687669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:28.687669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:28.687669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:28.687669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:28.687669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:28.687669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:28.687669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:28.687669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:51:28.687669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:28.687669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 247/494] 10.222.0.43 () {56 vars in 1093 bytes} [Wed May 25 13:51:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:28.687669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07fd79-6717-460e-b1a5-e1e743948e25 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:28.760989 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf38cb-5246-4f6b-881b-ddfb5dc41701 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:28.798002 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a93c6c-40a3-4f28-a3ab-d727f0689fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:28.799208 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93c6c-40a3-4f28-a3ab-d727f0689fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.799491 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93c6c-40a3-4f28-a3ab-d727f0689fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.799791 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93c6c-40a3-4f28-a3ab-d727f0689fa8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.811495 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a93c6c-40a3-4f28-a3ab-d727f0689fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:28.812459 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07fd79-6717-460e-b1a5-e1e743948e25 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a4a93c6c-40a3-4f28-a3ab-d727f0689fa8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:28.819434 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:28.820371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:28.821155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:28.821155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:28.821155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:28.821155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:28.821155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:28.821155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:28.821155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:28.821155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:28.821155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:28.821155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:28.821155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:28.821155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:28.821155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 248/495] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:28.821799 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a93c6c-40a3-4f28-a3ab-d727f0689fa8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:28.851603 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cb36d-30c7-4ae6-82e0-4ab17f9b249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:28.852297 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cb36d-30c7-4ae6-82e0-4ab17f9b249e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.852579 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cb36d-30c7-4ae6-82e0-4ab17f9b249e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.852855 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cb36d-30c7-4ae6-82e0-4ab17f9b249e None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.853569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cb36d-30c7-4ae6-82e0-4ab17f9b249e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:28.853874 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cb36d-30c7-4ae6-82e0-4ab17f9b249e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:28.855264 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cb36d-30c7-4ae6-82e0-4ab17f9b249e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:28.868523 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 248/496] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:28.869869 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330002c1-7ed4-4150-beb6-349c5a4eb2cf None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.870160 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330002c1-7ed4-4150-beb6-349c5a4eb2cf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.870437 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330002c1-7ed4-4150-beb6-349c5a4eb2cf None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.875820 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 249/497] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:28.876638 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330002c1-7ed4-4150-beb6-349c5a4eb2cf None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:28.891925 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:28.918352 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:28.933777 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a93c6c-40a3-4f28-a3ab-d727f0689fa8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:28.968415 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988672e-13d2-46bb-87fd-0f47056ae656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:28.969080 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988672e-13d2-46bb-87fd-0f47056ae656 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.969364 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988672e-13d2-46bb-87fd-0f47056ae656 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.969641 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988672e-13d2-46bb-87fd-0f47056ae656 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.970476 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988672e-13d2-46bb-87fd-0f47056ae656 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:28.970787 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988672e-13d2-46bb-87fd-0f47056ae656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:28.972944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988672e-13d2-46bb-87fd-0f47056ae656 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:28.978572 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330002c1-7ed4-4150-beb6-349c5a4eb2cf None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.009726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 249/498] 10.222.0.43 () {56 vars in 1133 bytes} [Wed May 25 13:51:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:29.010565 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988672e-13d2-46bb-87fd-0f47056ae656 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.015873 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70030be5-4497-4087-8d1b-aa0fffbab917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.016543 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70030be5-4497-4087-8d1b-aa0fffbab917 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.016828 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70030be5-4497-4087-8d1b-aa0fffbab917 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.017106 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70030be5-4497-4087-8d1b-aa0fffbab917 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.017854 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70030be5-4497-4087-8d1b-aa0fffbab917 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:29.018163 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70030be5-4497-4087-8d1b-aa0fffbab917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.020304 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70030be5-4497-4087-8d1b-aa0fffbab917 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.028583 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 250/499] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:29.029841 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b3607-faa0-48eb-aae0-96feebc74448 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.030130 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b3607-faa0-48eb-aae0-96feebc74448 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.030404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b3607-faa0-48eb-aae0-96feebc74448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.046574 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-cf5b3607-faa0-48eb-aae0-96feebc74448 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:29.047764 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cf5b3607-faa0-48eb-aae0-96feebc74448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:29.112600 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 251/500] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:29.114016 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a53bde-f983-4f8e-b45c-c970a4a849a9 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.114314 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a53bde-f983-4f8e-b45c-c970a4a849a9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.114590 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a53bde-f983-4f8e-b45c-c970a4a849a9 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.116029 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 252/501] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:29.117177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988672e-13d2-46bb-87fd-0f47056ae656 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.120597 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a53bde-f983-4f8e-b45c-c970a4a849a9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.125197 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:29.153459 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a9a93-44bc-4f47-bcda-9676e423529a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.154272 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a9a93-44bc-4f47-bcda-9676e423529a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.154561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a9a93-44bc-4f47-bcda-9676e423529a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.154851 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a9a93-44bc-4f47-bcda-9676e423529a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.162883 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a9a93-44bc-4f47-bcda-9676e423529a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.164378 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a9a93-44bc-4f47-bcda-9676e423529a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-574a9a93-44bc-4f47-bcda-9676e423529a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:29.180190 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:29.181195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:29.182248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:29.182248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:29.182248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:29.182248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:29.182248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:29.182248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:29.182248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:29.182248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:29.182248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:51:29.182248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:29.182248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 250/502] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:29.182248 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a9a93-44bc-4f47-bcda-9676e423529a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.186236 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:29.237633 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a53bde-f983-4f8e-b45c-c970a4a849a9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.271989 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bbac2-ff0b-4144-a9ce-9d8b98d27a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.272638 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bbac2-ff0b-4144-a9ce-9d8b98d27a62 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.272925 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bbac2-ff0b-4144-a9ce-9d8b98d27a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.273207 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bbac2-ff0b-4144-a9ce-9d8b98d27a62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.284065 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a9a93-44bc-4f47-bcda-9676e423529a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.319218 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783a705-1734-4989-bc4c-b8e6715ee22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.320049 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a705-1734-4989-bc4c-b8e6715ee22e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.320340 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a705-1734-4989-bc4c-b8e6715ee22e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.320623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a705-1734-4989-bc4c-b8e6715ee22e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.331218 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783a705-1734-4989-bc4c-b8e6715ee22e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.332796 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783a705-1734-4989-bc4c-b8e6715ee22e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.340431 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bbac2-ff0b-4144-a9ce-9d8b98d27a62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.341888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bbac2-ff0b-4144-a9ce-9d8b98d27a62 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.345220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9783a705-1734-4989-bc4c-b8e6715ee22e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:29.350670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:29.351499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:29.352392 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:29.352392 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:29.352392 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:29.352392 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:29.352392 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 251/503] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:29.353054 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57d70a-a033-4edc-b736-c7c1b1c49a2d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.353343 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57d70a-a033-4edc-b736-c7c1b1c49a2d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.353655 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57d70a-a033-4edc-b736-c7c1b1c49a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.370584 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ba57d70a-a033-4edc-b736-c7c1b1c49a2d None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:29.371807 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ba57d70a-a033-4edc-b736-c7c1b1c49a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:29.420691 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:29.437720 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 252/504] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:29.438470 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57d70a-a033-4edc-b736-c7c1b1c49a2d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.459571 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 253/505] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:29.460309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bbac2-ff0b-4144-a9ce-9d8b98d27a62 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.539067 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57d70a-a033-4edc-b736-c7c1b1c49a2d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.561416 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bbac2-ff0b-4144-a9ce-9d8b98d27a62 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.564137 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:29.576294 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0430f1-6681-4880-b7ff-868e38b6a302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.577090 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0430f1-6681-4880-b7ff-868e38b6a302 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.577376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0430f1-6681-4880-b7ff-868e38b6a302 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.577653 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0430f1-6681-4880-b7ff-868e38b6a302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.588115 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0430f1-6681-4880-b7ff-868e38b6a302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.589833 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0430f1-6681-4880-b7ff-868e38b6a302 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.594535 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c171b2-cd7e-4f1f-8f4f-38d3de1dd025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.595197 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c171b2-cd7e-4f1f-8f4f-38d3de1dd025 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.595477 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c171b2-cd7e-4f1f-8f4f-38d3de1dd025 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.595773 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c171b2-cd7e-4f1f-8f4f-38d3de1dd025 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.596607 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c171b2-cd7e-4f1f-8f4f-38d3de1dd025 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:29.597429 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c171b2-cd7e-4f1f-8f4f-38d3de1dd025 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.598973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c171b2-cd7e-4f1f-8f4f-38d3de1dd025 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0c0430f1-6681-4880-b7ff-868e38b6a302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:29.609373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:29.610270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:29.611117 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:29.611117 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:29.611117 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:29.611117 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:29.611117 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 253/506] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:29.611376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0430f1-6681-4880-b7ff-868e38b6a302 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.639095 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 254/507] 10.222.0.43 () {56 vars in 1137 bytes} [Wed May 25 13:51:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:29.640607 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c171b2-cd7e-4f1f-8f4f-38d3de1dd025 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.657915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:29.725897 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0430f1-6681-4880-b7ff-868e38b6a302 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.747160 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c171b2-cd7e-4f1f-8f4f-38d3de1dd025 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.761095 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ade99-b542-407e-950f-8b4aafdfb906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.761760 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ade99-b542-407e-950f-8b4aafdfb906 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.762049 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ade99-b542-407e-950f-8b4aafdfb906 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.762328 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ade99-b542-407e-950f-8b4aafdfb906 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.763052 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ade99-b542-407e-950f-8b4aafdfb906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:29.763364 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ade99-b542-407e-950f-8b4aafdfb906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.764771 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ade99-b542-407e-950f-8b4aafdfb906 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.775915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 254/508] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:29.776711 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ade99-b542-407e-950f-8b4aafdfb906 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.783766 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb876447-3e2f-4926-a8ce-d9b7e1cf5d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.785894 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb876447-3e2f-4926-a8ce-d9b7e1cf5d2a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.786179 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb876447-3e2f-4926-a8ce-d9b7e1cf5d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.786459 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb876447-3e2f-4926-a8ce-d9b7e1cf5d2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.796870 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb876447-3e2f-4926-a8ce-d9b7e1cf5d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.798348 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb876447-3e2f-4926-a8ce-d9b7e1cf5d2a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-cb876447-3e2f-4926-a8ce-d9b7e1cf5d2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:29.817619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:29.818489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:29.819332 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:29.819332 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:29.819332 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:29.819332 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:29.819332 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 255/509] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:29.820635 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb876447-3e2f-4926-a8ce-d9b7e1cf5d2a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.836284 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:29.872781 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:29.879140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ade99-b542-407e-950f-8b4aafdfb906 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.912493 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3a51e-6676-4e79-9c95-b46027e490bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.913316 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3a51e-6676-4e79-9c95-b46027e490bf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.913604 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3a51e-6676-4e79-9c95-b46027e490bf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.913885 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3a51e-6676-4e79-9c95-b46027e490bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.922341 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb876447-3e2f-4926-a8ce-d9b7e1cf5d2a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.924549 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3a51e-6676-4e79-9c95-b46027e490bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-79d3a51e-6676-4e79-9c95-b46027e490bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:29.932894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:29.933825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:29.934625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:29.934625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:29.934625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:29.934625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:29.934625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:29.934625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:29.934625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:29.934625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:29.934625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:29.934625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:29.934625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:29.934625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:29.934625 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 255/510] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:29.935286 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3a51e-6676-4e79-9c95-b46027e490bf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.963497 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e7342-fb95-4f67-ba98-1f46ac985264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.964682 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e7342-fb95-4f67-ba98-1f46ac985264 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.964966 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e7342-fb95-4f67-ba98-1f46ac985264 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.965251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e7342-fb95-4f67-ba98-1f46ac985264 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.965978 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e7342-fb95-4f67-ba98-1f46ac985264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:29.966296 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e7342-fb95-4f67-ba98-1f46ac985264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.967843 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e7342-fb95-4f67-ba98-1f46ac985264 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.988418 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 256/511] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:29.989269 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e7342-fb95-4f67-ba98-1f46ac985264 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:30.043270 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3a51e-6676-4e79-9c95-b46027e490bf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:30.064629 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:30.077412 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42be26-a084-4862-9fa1-1616fc1a6438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:30.078142 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42be26-a084-4862-9fa1-1616fc1a6438 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:30.078431 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42be26-a084-4862-9fa1-1616fc1a6438 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:30.078718 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42be26-a084-4862-9fa1-1616fc1a6438 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:30.089437 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e7342-fb95-4f67-ba98-1f46ac985264 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:30.105099 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:30.124230 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac09013-e675-48b1-96df-2eb9b45a79e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:30.125120 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac09013-e675-48b1-96df-2eb9b45a79e7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:30.125409 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac09013-e675-48b1-96df-2eb9b45a79e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:30.125678 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac09013-e675-48b1-96df-2eb9b45a79e7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:30.134050 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac09013-e675-48b1-96df-2eb9b45a79e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:30.135519 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac09013-e675-48b1-96df-2eb9b45a79e7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-dac09013-e675-48b1-96df-2eb9b45a79e7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:30.149885 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:30.150784 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:30.151706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:30.151706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:30.151706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:30.151706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:30.151706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:30.151706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:30.151706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:30.151706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:30.151706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 13:51:30.151706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:30.151706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 257/512] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:30.152692 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac09013-e675-48b1-96df-2eb9b45a79e7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:30.156901 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42be26-a084-4862-9fa1-1616fc1a6438 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:30.158400 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42be26-a084-4862-9fa1-1616fc1a6438 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:30.250495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac09013-e675-48b1-96df-2eb9b45a79e7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:30.258165 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 256/513] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:30.258997 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42be26-a084-4862-9fa1-1616fc1a6438 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:30.287261 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61882ebd-d884-42e9-9a13-d6f6ee1a8cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:30.288088 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61882ebd-d884-42e9-9a13-d6f6ee1a8cfd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:30.288379 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61882ebd-d884-42e9-9a13-d6f6ee1a8cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:30.288661 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61882ebd-d884-42e9-9a13-d6f6ee1a8cfd None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:30.289393 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61882ebd-d884-42e9-9a13-d6f6ee1a8cfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:30.289705 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61882ebd-d884-42e9-9a13-d6f6ee1a8cfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:30.291094 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61882ebd-d884-42e9-9a13-d6f6ee1a8cfd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:30.295171 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:30.304776 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 258/514] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:30.305589 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61882ebd-d884-42e9-9a13-d6f6ee1a8cfd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:30.320025 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:30.364785 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42be26-a084-4862-9fa1-1616fc1a6438 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:30.399810 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112cd75-5607-4dbf-9a4a-63b2108a265f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:30.400478 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112cd75-5607-4dbf-9a4a-63b2108a265f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:30.400769 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112cd75-5607-4dbf-9a4a-63b2108a265f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:30.401049 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112cd75-5607-4dbf-9a4a-63b2108a265f None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:30.401816 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112cd75-5607-4dbf-9a4a-63b2108a265f None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:30.402126 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112cd75-5607-4dbf-9a4a-63b2108a265f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:30.403509 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112cd75-5607-4dbf-9a4a-63b2108a265f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:30.404818 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61882ebd-d884-42e9-9a13-d6f6ee1a8cfd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:30.411542 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 257/515] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:30.412382 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112cd75-5607-4dbf-9a4a-63b2108a265f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:30.440198 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137ee14-0e45-4730-b6d5-e2f23ee55a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:30.441520 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137ee14-0e45-4730-b6d5-e2f23ee55a0c None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:30.441826 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137ee14-0e45-4730-b6d5-e2f23ee55a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:30.442104 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137ee14-0e45-4730-b6d5-e2f23ee55a0c None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:30.442805 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137ee14-0e45-4730-b6d5-e2f23ee55a0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:30.444291 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137ee14-0e45-4730-b6d5-e2f23ee55a0c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:30.509403 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 259/516] 10.222.0.43 () {60 vars in 1132 bytes} [Wed May 25 13:51:30 2022] POST /identity/v3/users => generated 247 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:30.510151 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137ee14-0e45-4730-b6d5-e2f23ee55a0c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:30.520709 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112cd75-5607-4dbf-9a4a-63b2108a265f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:30.541349 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:30.559232 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906a2ae-56ad-4143-abbe-db4b42e1683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:30.559946 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906a2ae-56ad-4143-abbe-db4b42e1683f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:30.560258 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906a2ae-56ad-4143-abbe-db4b42e1683f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:30.560513 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906a2ae-56ad-4143-abbe-db4b42e1683f None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:30.561425 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906a2ae-56ad-4143-abbe-db4b42e1683f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:30.561682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906a2ae-56ad-4143-abbe-db4b42e1683f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:30.563153 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906a2ae-56ad-4143-abbe-db4b42e1683f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:30.573271 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:30.585186 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 258/517] 10.222.0.43 () {56 vars in 1137 bytes} [Wed May 25 13:51:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:30.586602 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906a2ae-56ad-4143-abbe-db4b42e1683f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:30.639205 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137ee14-0e45-4730-b6d5-e2f23ee55a0c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:30.680457 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95a568-1175-4da2-be57-0907a2c67c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:30.681641 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95a568-1175-4da2-be57-0907a2c67c24 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:30.682066 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95a568-1175-4da2-be57-0907a2c67c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:30.682471 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95a568-1175-4da2-be57-0907a2c67c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:30.695780 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95a568-1175-4da2-be57-0907a2c67c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:30.697299 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95a568-1175-4da2-be57-0907a2c67c24 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:30.708615 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906a2ae-56ad-4143-abbe-db4b42e1683f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-fb95a568-1175-4da2-be57-0907a2c67c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:30.716038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:30.716856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:30.717724 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:30.717724 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:30.717724 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:30.717724 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:30.717724 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 260/518] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:30.718810 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95a568-1175-4da2-be57-0907a2c67c24 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:30.751586 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8fc60-5211-4b5c-86ee-936840719e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:30.752449 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8fc60-5211-4b5c-86ee-936840719e41 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:30.753259 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8fc60-5211-4b5c-86ee-936840719e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:30.753259 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8fc60-5211-4b5c-86ee-936840719e41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:30.760764 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8fc60-5211-4b5c-86ee-936840719e41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:30.762161 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8fc60-5211-4b5c-86ee-936840719e41 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-97e8fc60-5211-4b5c-86ee-936840719e41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:30.776881 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:30.777767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:30.778593 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:30.778593 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:30.778593 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:30.778593 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:30.778593 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:30.778593 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:30.778593 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:30.778593 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:30.778593 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 259/519] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:30.779244 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8fc60-5211-4b5c-86ee-936840719e41 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:30.818911 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:30.834787 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95a568-1175-4da2-be57-0907a2c67c24 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:30.836396 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:30.873780 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c95a0-ed92-4511-8411-7c84580597de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:30.875014 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c95a0-ed92-4511-8411-7c84580597de None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:30.875602 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c95a0-ed92-4511-8411-7c84580597de None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:30.875984 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c95a0-ed92-4511-8411-7c84580597de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:30.886759 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c95a0-ed92-4511-8411-7c84580597de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:30.888297 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c95a0-ed92-4511-8411-7c84580597de None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:30.888727 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8fc60-5211-4b5c-86ee-936840719e41 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-6a4c95a0-ed92-4511-8411-7c84580597de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:30.907458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:30.908372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:30.910019 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:30.910019 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:30.910019 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:30.910019 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:30.910019 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 261/520] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:30.910019 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c95a0-ed92-4511-8411-7c84580597de None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:30.933186 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9136-8093-4623-aece-f0e1e8210cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:30.933928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9136-8093-4623-aece-f0e1e8210cad None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:30.934217 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9136-8093-4623-aece-f0e1e8210cad None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:30.934492 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9136-8093-4623-aece-f0e1e8210cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:31.007889 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f9136-8093-4623-aece-f0e1e8210cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:31.009358 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f9136-8093-4623-aece-f0e1e8210cad None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:31.016866 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c95a0-ed92-4511-8411-7c84580597de None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:31.046543 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:31.056976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac04f5-d3f2-4e43-93ba-8e2b763b23f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:31.058977 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac04f5-d3f2-4e43-93ba-8e2b763b23f4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:31.058977 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac04f5-d3f2-4e43-93ba-8e2b763b23f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:31.058977 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac04f5-d3f2-4e43-93ba-8e2b763b23f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:31.058977 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac04f5-d3f2-4e43-93ba-8e2b763b23f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:31.059234 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac04f5-d3f2-4e43-93ba-8e2b763b23f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:31.060690 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac04f5-d3f2-4e43-93ba-8e2b763b23f4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:31.077161 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 262/521] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:31.077161 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac04f5-d3f2-4e43-93ba-8e2b763b23f4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:31.093699 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:31.122331 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 260/522] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:31.123182 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9136-8093-4623-aece-f0e1e8210cad None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:31.192178 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac04f5-d3f2-4e43-93ba-8e2b763b23f4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:31.228225 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9136-8093-4623-aece-f0e1e8210cad None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:31.228738 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554f86c-7141-4933-8a9e-665acbe63b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:31.229400 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554f86c-7141-4933-8a9e-665acbe63b3d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:31.229757 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554f86c-7141-4933-8a9e-665acbe63b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:31.229952 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554f86c-7141-4933-8a9e-665acbe63b3d None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:31.231114 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554f86c-7141-4933-8a9e-665acbe63b3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:31.231114 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554f86c-7141-4933-8a9e-665acbe63b3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:31.232505 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554f86c-7141-4933-8a9e-665acbe63b3d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:31.250792 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 263/523] 10.222.0.43 () {56 vars in 1148 bytes} [Wed May 25 13:51:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:31.256141 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554f86c-7141-4933-8a9e-665acbe63b3d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:31.268958 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45efc0-02d4-4ba9-bb98-1bece6da1cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:31.269757 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45efc0-02d4-4ba9-bb98-1bece6da1cae None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:31.270105 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45efc0-02d4-4ba9-bb98-1bece6da1cae None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:31.270448 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45efc0-02d4-4ba9-bb98-1bece6da1cae None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:31.271243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45efc0-02d4-4ba9-bb98-1bece6da1cae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:31.271621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45efc0-02d4-4ba9-bb98-1bece6da1cae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:31.273071 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45efc0-02d4-4ba9-bb98-1bece6da1cae None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:31.276314 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:31.287984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 261/524] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:31.290868 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45efc0-02d4-4ba9-bb98-1bece6da1cae None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:31.345558 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:31.378344 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554f86c-7141-4933-8a9e-665acbe63b3d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:31.399635 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45efc0-02d4-4ba9-bb98-1bece6da1cae None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:31.415135 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfa050-fa81-4f2e-99f9-4de0f8b6adf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:31.415745 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfa050-fa81-4f2e-99f9-4de0f8b6adf5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:31.416058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfa050-fa81-4f2e-99f9-4de0f8b6adf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:31.416341 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfa050-fa81-4f2e-99f9-4de0f8b6adf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:31.423048 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfa050-fa81-4f2e-99f9-4de0f8b6adf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:31.424559 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfa050-fa81-4f2e-99f9-4de0f8b6adf5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:31.435776 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203340ba-af22-4801-9a07-69a3241ee76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:31.436563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203340ba-af22-4801-9a07-69a3241ee76b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:31.436849 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203340ba-af22-4801-9a07-69a3241ee76b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:31.437127 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203340ba-af22-4801-9a07-69a3241ee76b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-22bfa050-fa81-4f2e-99f9-4de0f8b6adf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:31.440054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:31.441146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:31.446918 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:31.446918 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:31.446918 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:31.446918 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:31.446918 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:31.446918 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:31.446918 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:31.446918 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:31.446918 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 264/525] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:31.446918 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfa050-fa81-4f2e-99f9-4de0f8b6adf5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:31.452757 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203340ba-af22-4801-9a07-69a3241ee76b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:31.454244 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203340ba-af22-4801-9a07-69a3241ee76b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-203340ba-af22-4801-9a07-69a3241ee76b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:31.474534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:31.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:31.485214 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:31.485214 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:31.485214 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:31.485214 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:31.485214 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 262/526] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:31.485214 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203340ba-af22-4801-9a07-69a3241ee76b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:31.537209 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:31.559604 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfa050-fa81-4f2e-99f9-4de0f8b6adf5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:31.592049 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203340ba-af22-4801-9a07-69a3241ee76b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:31.600959 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc6cfd-00f5-40b6-9252-ed752b26c7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:31.601907 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6cfd-00f5-40b6-9252-ed752b26c7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:31.602501 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6cfd-00f5-40b6-9252-ed752b26c7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:31.602975 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6cfd-00f5-40b6-9252-ed752b26c7f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:31.604163 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc6cfd-00f5-40b6-9252-ed752b26c7f9 None admin] RBAC: Adding query filter params (role.id=97c702855bb64e118e62642a59a444b9, scope.project.id=8686972299d942168ba6ed9c25bf6ec9, user.id=c1dc40f3b4a942f9b52ec74452309aac) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:31.604686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc6cfd-00f5-40b6-9252-ed752b26c7f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:31.606338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc6cfd-00f5-40b6-9252-ed752b26c7f9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:31.608443 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:31.623739 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 265/527] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:51:31 2022] GET /identity/v3/role_assignments?user.id=c1dc40f3b4a942f9b52ec74452309aac&scope.project.id=8686972299d942168ba6ed9c25bf6ec9&role.id=97c702855bb64e118e62642a59a444b9 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:31.623739 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc6cfd-00f5-40b6-9252-ed752b26c7f9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:31.644130 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757857a-1455-46cf-8417-b6aee2bf90fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:31.645221 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757857a-1455-46cf-8417-b6aee2bf90fb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:31.645674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757857a-1455-46cf-8417-b6aee2bf90fb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:31.646051 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757857a-1455-46cf-8417-b6aee2bf90fb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:31.656322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757857a-1455-46cf-8417-b6aee2bf90fb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:31.658034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757857a-1455-46cf-8417-b6aee2bf90fb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c757857a-1455-46cf-8417-b6aee2bf90fb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:31.675686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:31.676780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:31.677825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:31.677825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:31.677825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:31.677825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:31.677825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:31.677825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:31.677825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:31.677825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:31.677825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:51:31.677825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:31.677825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 263/528] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:31.679470 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757857a-1455-46cf-8417-b6aee2bf90fb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:31.729061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc6cfd-00f5-40b6-9252-ed752b26c7f9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:31.766311 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4a480-ac1f-4d54-978d-be291fd5bb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:31.766982 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4a480-ac1f-4d54-978d-be291fd5bb22 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:31.767265 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4a480-ac1f-4d54-978d-be291fd5bb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:31.767534 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4a480-ac1f-4d54-978d-be291fd5bb22 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:31.768369 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4a480-ac1f-4d54-978d-be291fd5bb22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:31.768977 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4a480-ac1f-4d54-978d-be291fd5bb22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:31.770348 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4a480-ac1f-4d54-978d-be291fd5bb22 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:31.786113 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 266/529] 10.222.0.43 () {56 vars in 1148 bytes} [Wed May 25 13:51:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:31.786113 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4a480-ac1f-4d54-978d-be291fd5bb22 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:31.806952 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757857a-1455-46cf-8417-b6aee2bf90fb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:31.822861 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:31.855910 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f50387-e3bc-4e5c-b047-ecdcf31ddacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:31.856586 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f50387-e3bc-4e5c-b047-ecdcf31ddacd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:31.856878 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f50387-e3bc-4e5c-b047-ecdcf31ddacd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:31.857159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f50387-e3bc-4e5c-b047-ecdcf31ddacd None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:31.857888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f50387-e3bc-4e5c-b047-ecdcf31ddacd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:31.858199 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f50387-e3bc-4e5c-b047-ecdcf31ddacd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:31.861299 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f50387-e3bc-4e5c-b047-ecdcf31ddacd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:31.885978 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 264/530] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:31.886689 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:31.887512 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f50387-e3bc-4e5c-b047-ecdcf31ddacd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:31.938928 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4a480-ac1f-4d54-978d-be291fd5bb22 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:31.985425 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b33506-f157-4dc3-998c-ef3a76ef7e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:31.986373 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b33506-f157-4dc3-998c-ef3a76ef7e8f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:31.986680 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b33506-f157-4dc3-998c-ef3a76ef7e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:31.986961 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b33506-f157-4dc3-998c-ef3a76ef7e8f None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:31.988586 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b33506-f157-4dc3-998c-ef3a76ef7e8f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:31.988903 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b33506-f157-4dc3-998c-ef3a76ef7e8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:31.990770 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b33506-f157-4dc3-998c-ef3a76ef7e8f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:32.015150 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 267/531] 10.222.0.43 () {56 vars in 1139 bytes} [Wed May 25 13:51:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:32.016032 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b33506-f157-4dc3-998c-ef3a76ef7e8f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:32.053971 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f50387-e3bc-4e5c-b047-ecdcf31ddacd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:32.089573 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be769e9-35ef-4d16-a37d-b36b159952cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:32.090326 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be769e9-35ef-4d16-a37d-b36b159952cf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:32.090703 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be769e9-35ef-4d16-a37d-b36b159952cf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:32.091091 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be769e9-35ef-4d16-a37d-b36b159952cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:32.092106 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be769e9-35ef-4d16-a37d-b36b159952cf None admin] RBAC: Adding query filter params (role.id=97c702855bb64e118e62642a59a444b9, scope.project.id=8686972299d942168ba6ed9c25bf6ec9, user.id=1cb9736c4af44cc0aa1f32878081baff) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:32.092517 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be769e9-35ef-4d16-a37d-b36b159952cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:32.094082 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be769e9-35ef-4d16-a37d-b36b159952cf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:32.107904 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 265/532] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:51:31 2022] GET /identity/v3/role_assignments?user.id=1cb9736c4af44cc0aa1f32878081baff&scope.project.id=8686972299d942168ba6ed9c25bf6ec9&role.id=97c702855bb64e118e62642a59a444b9 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:32.109057 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be769e9-35ef-4d16-a37d-b36b159952cf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:32.142786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b33506-f157-4dc3-998c-ef3a76ef7e8f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:32.165841 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:32.204759 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c400-ece7-40ff-bc0a-153d6453af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:32.206539 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c400-ece7-40ff-bc0a-153d6453af90 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:32.207325 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c400-ece7-40ff-bc0a-153d6453af90 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:32.208094 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c400-ece7-40ff-bc0a-153d6453af90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:32.208293 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:32.220160 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6c400-ece7-40ff-bc0a-153d6453af90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:32.227882 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6c400-ece7-40ff-bc0a-153d6453af90 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-14e6c400-ece7-40ff-bc0a-153d6453af90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:32.251545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:32.252700 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:32.254117 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:32.254117 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:32.254117 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:32.254117 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:32.254117 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:32.254117 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:32.254117 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:32.254117 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:32.254117 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 268/533] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:32.259501 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c400-ece7-40ff-bc0a-153d6453af90 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:32.265642 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be769e9-35ef-4d16-a37d-b36b159952cf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:32.319508 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c30fb-12f6-4da0-9dd0-7dfdd756e1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:32.320311 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c30fb-12f6-4da0-9dd0-7dfdd756e1ef None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:32.320670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c30fb-12f6-4da0-9dd0-7dfdd756e1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:32.320958 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c30fb-12f6-4da0-9dd0-7dfdd756e1ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:32.409654 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c30fb-12f6-4da0-9dd0-7dfdd756e1ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:32.411911 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c30fb-12f6-4da0-9dd0-7dfdd756e1ef None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:32.449582 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c400-ece7-40ff-bc0a-153d6453af90 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:32.488136 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:32.528433 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5038fd0-ff28-48fe-ab27-0a11972d3804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:32.529484 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5038fd0-ff28-48fe-ab27-0a11972d3804 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:32.529773 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5038fd0-ff28-48fe-ab27-0a11972d3804 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:32.530054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5038fd0-ff28-48fe-ab27-0a11972d3804 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:32.530852 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5038fd0-ff28-48fe-ab27-0a11972d3804 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:32.531166 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5038fd0-ff28-48fe-ab27-0a11972d3804 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:32.532681 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5038fd0-ff28-48fe-ab27-0a11972d3804 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:32.555632 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 269/534] 10.222.0.43 () {56 vars in 1148 bytes} [Wed May 25 13:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:32.564747 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5038fd0-ff28-48fe-ab27-0a11972d3804 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:32.608030 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 266/535] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:32.613656 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c30fb-12f6-4da0-9dd0-7dfdd756e1ef None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:32.642658 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:32.783424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5038fd0-ff28-48fe-ab27-0a11972d3804 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:32.821525 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c30fb-12f6-4da0-9dd0-7dfdd756e1ef None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:32.827216 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ec1f7-ceb4-4015-b1f9-f3dd0fd70abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:32.828104 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ec1f7-ceb4-4015-b1f9-f3dd0fd70abb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:32.828387 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ec1f7-ceb4-4015-b1f9-f3dd0fd70abb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:32.828662 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ec1f7-ceb4-4015-b1f9-f3dd0fd70abb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:32.829526 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ec1f7-ceb4-4015-b1f9-f3dd0fd70abb None admin] RBAC: Adding query filter params (role.id=97c702855bb64e118e62642a59a444b9, scope.project.id=8686972299d942168ba6ed9c25bf6ec9, user.id=67f88f575ce742d584db7fa53d986143) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:32.829905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ec1f7-ceb4-4015-b1f9-f3dd0fd70abb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:32.831589 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ec1f7-ceb4-4015-b1f9-f3dd0fd70abb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:32.843956 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 270/536] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:51:32 2022] GET /identity/v3/role_assignments?user.id=67f88f575ce742d584db7fa53d986143&scope.project.id=8686972299d942168ba6ed9c25bf6ec9&role.id=97c702855bb64e118e62642a59a444b9 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:32.855397 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:32.860899 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd96bd-3df7-4b37-b0dd-c45cad863e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:32.861799 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd96bd-3df7-4b37-b0dd-c45cad863e61 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:32.862589 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd96bd-3df7-4b37-b0dd-c45cad863e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:32.867333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd96bd-3df7-4b37-b0dd-c45cad863e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:32.876452 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd96bd-3df7-4b37-b0dd-c45cad863e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:32.878338 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd96bd-3df7-4b37-b0dd-c45cad863e61 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b7bd96bd-3df7-4b37-b0dd-c45cad863e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:32.898252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:32.899167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:32.900042 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:32.900042 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:32.900042 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:32.900042 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:32.900042 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 267/537] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:32.905776 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ec1f7-ceb4-4015-b1f9-f3dd0fd70abb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:32.936693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584cb9a-8515-4e16-935a-5149da46471d None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:32.937329 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584cb9a-8515-4e16-935a-5149da46471d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:32.937834 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584cb9a-8515-4e16-935a-5149da46471d None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:32.939815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 268/538] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:32.945826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea680a-d3a5-462a-9342-b82ad97abb3e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:32.946437 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea680a-d3a5-462a-9342-b82ad97abb3e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:32.947018 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea680a-d3a5-462a-9342-b82ad97abb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:32.980978 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-60ea680a-d3a5-462a-9342-b82ad97abb3e None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:32.983564 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-60ea680a-d3a5-462a-9342-b82ad97abb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:33.088903 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:33.092331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ec1f7-ceb4-4015-b1f9-f3dd0fd70abb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:33.093584 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 269/539] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:51:33.121725 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea680a-d3a5-462a-9342-b82ad97abb3e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:33.151410 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a895350-405a-407f-b08d-051107a365fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:33.152474 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895350-405a-407f-b08d-051107a365fd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:33.153006 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895350-405a-407f-b08d-051107a365fd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:33.153566 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895350-405a-407f-b08d-051107a365fd None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:33.154486 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a895350-405a-407f-b08d-051107a365fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:33.155020 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a895350-405a-407f-b08d-051107a365fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:33.156722 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a895350-405a-407f-b08d-051107a365fd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:33.174021 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 271/540] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:33.177047 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a895350-405a-407f-b08d-051107a365fd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:33.244948 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea680a-d3a5-462a-9342-b82ad97abb3e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:33.274112 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:33.290601 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c852e-d550-42b5-9219-83abc1fb2926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:33.291406 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c852e-d550-42b5-9219-83abc1fb2926 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:33.293456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c852e-d550-42b5-9219-83abc1fb2926 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:33.293456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c852e-d550-42b5-9219-83abc1fb2926 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:33.308985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c852e-d550-42b5-9219-83abc1fb2926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-231c852e-d550-42b5-9219-83abc1fb2926 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:33.317928 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:33.318815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:33.319994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:33.319994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:33.319994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:33.319994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:33.319994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:33.319994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:33.319994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:33.319994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:33.319994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:33.319994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:33.319994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:33.319994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:33.319994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 270/541] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:33.327159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c852e-d550-42b5-9219-83abc1fb2926 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:33.409715 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a895350-405a-407f-b08d-051107a365fd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:33.486128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc4b57-e7cd-4f8e-9303-0d1b9d6f69e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:33.486930 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4b57-e7cd-4f8e-9303-0d1b9d6f69e3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:33.487924 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4b57-e7cd-4f8e-9303-0d1b9d6f69e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:33.488245 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4b57-e7cd-4f8e-9303-0d1b9d6f69e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:33.500317 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc4b57-e7cd-4f8e-9303-0d1b9d6f69e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:33.502000 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc4b57-e7cd-4f8e-9303-0d1b9d6f69e3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-18dc4b57-e7cd-4f8e-9303-0d1b9d6f69e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:33.526193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:33.528251 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:33.530334 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:33.530334 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:33.530334 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:33.530334 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:33.530334 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:33.530334 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:33.530334 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:33.530334 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:33.530334 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 272/542] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:33.538418 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc4b57-e7cd-4f8e-9303-0d1b9d6f69e3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:33.547028 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c852e-d550-42b5-9219-83abc1fb2926 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:33.582427 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:33.584142 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a94d0b-7317-46f3-b0e3-ddfd3889086f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:33.584814 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a94d0b-7317-46f3-b0e3-ddfd3889086f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:33.585097 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a94d0b-7317-46f3-b0e3-ddfd3889086f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:33.585375 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a94d0b-7317-46f3-b0e3-ddfd3889086f None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:33.586124 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a94d0b-7317-46f3-b0e3-ddfd3889086f None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:33.586431 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a94d0b-7317-46f3-b0e3-ddfd3889086f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:33.587847 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a94d0b-7317-46f3-b0e3-ddfd3889086f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:33.598862 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 271/543] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:33.604907 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a94d0b-7317-46f3-b0e3-ddfd3889086f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:33.676511 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:33.739241 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc4b57-e7cd-4f8e-9303-0d1b9d6f69e3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:33.777957 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7c30e-87f3-4816-b81a-bbc8a4be22f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:33.778634 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7c30e-87f3-4816-b81a-bbc8a4be22f8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:33.778926 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7c30e-87f3-4816-b81a-bbc8a4be22f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:33.779217 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7c30e-87f3-4816-b81a-bbc8a4be22f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:33.780578 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7c30e-87f3-4816-b81a-bbc8a4be22f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:33.780903 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7c30e-87f3-4816-b81a-bbc8a4be22f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:33.782469 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7c30e-87f3-4816-b81a-bbc8a4be22f8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:33.796937 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 273/544] 10.222.0.43 () {56 vars in 1148 bytes} [Wed May 25 13:51:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:33.803174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7c30e-87f3-4816-b81a-bbc8a4be22f8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:33.840056 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a94d0b-7317-46f3-b0e3-ddfd3889086f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:33.918235 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:33.940678 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda950d-dbdb-4703-8220-d5f9b8e2566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:33.940678 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda950d-dbdb-4703-8220-d5f9b8e2566a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:33.940678 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda950d-dbdb-4703-8220-d5f9b8e2566a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:33.940678 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda950d-dbdb-4703-8220-d5f9b8e2566a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:33.941465 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7c30e-87f3-4816-b81a-bbc8a4be22f8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:33.958419 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda950d-dbdb-4703-8220-d5f9b8e2566a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:33.959921 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda950d-dbdb-4703-8220-d5f9b8e2566a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4dda950d-dbdb-4703-8220-d5f9b8e2566a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:33.991424 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:33.993639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:33.995733 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:33.995733 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:33.995733 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:33.995733 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:33.995733 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 272/545] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:33.996347 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86a58b-ea2a-4ea7-a0c8-caf5c770aa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:33.996347 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86a58b-ea2a-4ea7-a0c8-caf5c770aa0e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:33.996347 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86a58b-ea2a-4ea7-a0c8-caf5c770aa0e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:33.996347 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86a58b-ea2a-4ea7-a0c8-caf5c770aa0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:33.996892 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86a58b-ea2a-4ea7-a0c8-caf5c770aa0e None admin] RBAC: Adding query filter params (role.id=97c702855bb64e118e62642a59a444b9, scope.project.id=8686972299d942168ba6ed9c25bf6ec9, user.id=7c0f3b9c9a1744cc965412231e96a74c) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:33.996892 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86a58b-ea2a-4ea7-a0c8-caf5c770aa0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:34.000016 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86a58b-ea2a-4ea7-a0c8-caf5c770aa0e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:34.004752 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 274/546] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:51:33 2022] GET /identity/v3/role_assignments?user.id=7c0f3b9c9a1744cc965412231e96a74c&scope.project.id=8686972299d942168ba6ed9c25bf6ec9&role.id=97c702855bb64e118e62642a59a444b9 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:34.005520 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda950d-dbdb-4703-8220-d5f9b8e2566a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:34.111821 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:34.126353 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda950d-dbdb-4703-8220-d5f9b8e2566a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:34.172223 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b329d3e-6df5-4ca9-bf9f-0e2e9b0d5948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:34.172910 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b329d3e-6df5-4ca9-bf9f-0e2e9b0d5948 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:34.173200 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b329d3e-6df5-4ca9-bf9f-0e2e9b0d5948 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:34.173759 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b329d3e-6df5-4ca9-bf9f-0e2e9b0d5948 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:34.174209 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b329d3e-6df5-4ca9-bf9f-0e2e9b0d5948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:34.175069 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b329d3e-6df5-4ca9-bf9f-0e2e9b0d5948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:34.176495 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b329d3e-6df5-4ca9-bf9f-0e2e9b0d5948 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:34.190970 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 273/547] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:34.196491 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86a58b-ea2a-4ea7-a0c8-caf5c770aa0e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:34.316515 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86a58b-ea2a-4ea7-a0c8-caf5c770aa0e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:34.359223 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1853c-7484-43bd-b181-b62cae172176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:34.360065 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1853c-7484-43bd-b181-b62cae172176 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:34.360355 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1853c-7484-43bd-b181-b62cae172176 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:34.360920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1853c-7484-43bd-b181-b62cae172176 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:34.369316 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1853c-7484-43bd-b181-b62cae172176 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:34.370788 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1853c-7484-43bd-b181-b62cae172176 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-acb1853c-7484-43bd-b181-b62cae172176 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:34.386108 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:34.387220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:34.389339 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:34.389339 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:34.389339 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:34.389339 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:34.389339 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:34.389339 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:34.389339 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:34.389339 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:34.389339 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:51:34.389339 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:34.389339 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 275/548] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:51:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:34.392824 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b329d3e-6df5-4ca9-bf9f-0e2e9b0d5948 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:34.456300 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e1bf0-7d82-4bfd-b3d0-2f8f7acbb0a3 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:34.456688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e1bf0-7d82-4bfd-b3d0-2f8f7acbb0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:34.456974 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e1bf0-7d82-4bfd-b3d0-2f8f7acbb0a3 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:34.458348 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 276/549] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:34.473837 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819191f8-f49d-419e-a06c-e9a944342703 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:34.474109 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819191f8-f49d-419e-a06c-e9a944342703 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:34.474400 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819191f8-f49d-419e-a06c-e9a944342703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:34.482144 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:34.504305 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-819191f8-f49d-419e-a06c-e9a944342703 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:34.505509 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-819191f8-f49d-419e-a06c-e9a944342703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:34.550110 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b329d3e-6df5-4ca9-bf9f-0e2e9b0d5948 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:34.597493 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d3670-7511-4948-a258-f709317f70ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:34.598186 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d3670-7511-4948-a258-f709317f70ba None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:34.598472 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d3670-7511-4948-a258-f709317f70ba None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:34.598750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d3670-7511-4948-a258-f709317f70ba None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:34.599600 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d3670-7511-4948-a258-f709317f70ba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:34.599939 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d3670-7511-4948-a258-f709317f70ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:34.602717 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d3670-7511-4948-a258-f709317f70ba None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:34.634174 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 274/550] 10.222.0.43 () {56 vars in 1135 bytes} [Wed May 25 13:51:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:34.640073 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d3670-7511-4948-a258-f709317f70ba None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:34.649758 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:34.710005 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 277/551] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:51:34.754729 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819191f8-f49d-419e-a06c-e9a944342703 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:34.754924 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d3670-7511-4948-a258-f709317f70ba None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:34.798588 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288323b-cba3-4402-af5b-f50c263a7f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:34.799246 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288323b-cba3-4402-af5b-f50c263a7f8c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:34.800151 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288323b-cba3-4402-af5b-f50c263a7f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:34.800404 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288323b-cba3-4402-af5b-f50c263a7f8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:34.870648 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819191f8-f49d-419e-a06c-e9a944342703 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:34.891477 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288323b-cba3-4402-af5b-f50c263a7f8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:34.892999 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288323b-cba3-4402-af5b-f50c263a7f8c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:34.905509 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:34.910275 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441097a5-141f-4e87-9e70-c4f3cb204495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:34.911310 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441097a5-141f-4e87-9e70-c4f3cb204495 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:34.911624 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441097a5-141f-4e87-9e70-c4f3cb204495 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:34.912054 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441097a5-141f-4e87-9e70-c4f3cb204495 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:34.914280 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:34.923706 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441097a5-141f-4e87-9e70-c4f3cb204495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-441097a5-141f-4e87-9e70-c4f3cb204495 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:34.931888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:34.933128 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:34.934169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:34.934169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:34.934169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:34.934169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:34.934169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:34.934169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:34.934169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:34.934169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:34.934169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:34.934169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:34.934169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:34.934169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:34.940808 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 278/552] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:34.942360 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03116-4411-4665-8724-0f4a64dcbddc None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:34.942750 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03116-4411-4665-8724-0f4a64dcbddc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:34.943143 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03116-4411-4665-8724-0f4a64dcbddc None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:34.944822 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 279/553] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:34.945619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e03116-4411-4665-8724-0f4a64dcbddc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:35.043912 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 275/554] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:35.043912 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6628b-7340-428d-927d-a9cfb2c64181 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:35.043912 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6628b-7340-428d-927d-a9cfb2c64181 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:35.043912 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6628b-7340-428d-927d-a9cfb2c64181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:35.065398 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c1e6628b-7340-428d-927d-a9cfb2c64181 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:35.068045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c1e6628b-7340-428d-927d-a9cfb2c64181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:35.069882 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e03116-4411-4665-8724-0f4a64dcbddc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:35.107900 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d596b-58d4-4cd7-978c-509c89e375d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:35.108597 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d596b-58d4-4cd7-978c-509c89e375d8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:35.108879 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d596b-58d4-4cd7-978c-509c89e375d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:35.109163 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d596b-58d4-4cd7-978c-509c89e375d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:35.109907 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d596b-58d4-4cd7-978c-509c89e375d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:35.110215 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d596b-58d4-4cd7-978c-509c89e375d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:35.111616 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d596b-58d4-4cd7-978c-509c89e375d8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:35.120645 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 280/555] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:35.121473 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d596b-58d4-4cd7-978c-509c89e375d8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:35.162794 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 276/556] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:35.164010 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6628b-7340-428d-927d-a9cfb2c64181 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:35.209033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:35.215416 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:35.263063 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d596b-58d4-4cd7-978c-509c89e375d8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:35.307687 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b748b5-ad50-4733-8684-5cae3cc8ae1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:35.308908 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b748b5-ad50-4733-8684-5cae3cc8ae1a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:35.309373 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b748b5-ad50-4733-8684-5cae3cc8ae1a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:35.309971 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b748b5-ad50-4733-8684-5cae3cc8ae1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:35.314643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6628b-7340-428d-927d-a9cfb2c64181 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:35.323996 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b748b5-ad50-4733-8684-5cae3cc8ae1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:35.325882 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b748b5-ad50-4733-8684-5cae3cc8ae1a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a9b748b5-ad50-4733-8684-5cae3cc8ae1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:35.347051 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:35.348384 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:35.349245 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:35.349245 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:35.349245 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:35.349245 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:35.349245 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 281/557] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:35.349779 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b748b5-ad50-4733-8684-5cae3cc8ae1a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:35.367151 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779b75-8d74-4183-bd64-005e289601da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:35.368277 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779b75-8d74-4183-bd64-005e289601da None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:35.368572 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779b75-8d74-4183-bd64-005e289601da None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:35.368856 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779b75-8d74-4183-bd64-005e289601da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:35.384236 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c779b75-8d74-4183-bd64-005e289601da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:35.386022 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c779b75-8d74-4183-bd64-005e289601da None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6c779b75-8d74-4183-bd64-005e289601da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:35.411895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:35.413283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:35.414162 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:35.414162 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:35.414162 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:35.414162 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:35.414162 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 277/558] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:35.415810 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779b75-8d74-4183-bd64-005e289601da None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:35.475048 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b748b5-ad50-4733-8684-5cae3cc8ae1a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:35.486785 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:35.538844 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:35.551748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779b75-8d74-4183-bd64-005e289601da None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:35.554814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60b1b5-6841-41bd-8db2-b9b5122a4f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:35.555609 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60b1b5-6841-41bd-8db2-b9b5122a4f2e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:35.555903 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60b1b5-6841-41bd-8db2-b9b5122a4f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:35.556173 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60b1b5-6841-41bd-8db2-b9b5122a4f2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:35.567983 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60b1b5-6841-41bd-8db2-b9b5122a4f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-fa60b1b5-6841-41bd-8db2-b9b5122a4f2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:35.575599 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:35.576736 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:35.577814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:35.577814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:35.577814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:35.577814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:35.577814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:35.577814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:35.577814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:35.577814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:35.577814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:35.577814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:35.577814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:35.577814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:35.577814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 282/559] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:35.578524 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60b1b5-6841-41bd-8db2-b9b5122a4f2e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:35.593374 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386dd2f-31cd-40d7-af26-652a48ea007e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:35.594041 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386dd2f-31cd-40d7-af26-652a48ea007e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:35.594329 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386dd2f-31cd-40d7-af26-652a48ea007e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:35.594602 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386dd2f-31cd-40d7-af26-652a48ea007e None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:35.595328 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386dd2f-31cd-40d7-af26-652a48ea007e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:35.595634 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386dd2f-31cd-40d7-af26-652a48ea007e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:35.597280 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386dd2f-31cd-40d7-af26-652a48ea007e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:35.609456 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 278/560] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:35.610716 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa568c-7cee-4694-b8ab-34c340ca3f64 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:35.611006 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa568c-7cee-4694-b8ab-34c340ca3f64 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:35.611280 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa568c-7cee-4694-b8ab-34c340ca3f64 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:35.617076 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 279/561] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:35.617883 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa568c-7cee-4694-b8ab-34c340ca3f64 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:35.694690 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60b1b5-6841-41bd-8db2-b9b5122a4f2e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:35.729602 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd7e34-7dd1-4b7e-b712-3d651a8a40ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:35.730267 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd7e34-7dd1-4b7e-b712-3d651a8a40ea None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:35.730548 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd7e34-7dd1-4b7e-b712-3d651a8a40ea None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:35.730826 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd7e34-7dd1-4b7e-b712-3d651a8a40ea None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:35.731545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd7e34-7dd1-4b7e-b712-3d651a8a40ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:35.731894 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd7e34-7dd1-4b7e-b712-3d651a8a40ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:35.732116 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa568c-7cee-4694-b8ab-34c340ca3f64 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:35.733271 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd7e34-7dd1-4b7e-b712-3d651a8a40ea None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:35.751024 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 283/562] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:35.751024 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd7e34-7dd1-4b7e-b712-3d651a8a40ea None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:35.774937 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c5878-fc2e-4b15-9eda-196a0da0f38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:35.775618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c5878-fc2e-4b15-9eda-196a0da0f38a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:35.775934 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c5878-fc2e-4b15-9eda-196a0da0f38a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:35.776214 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c5878-fc2e-4b15-9eda-196a0da0f38a None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:35.776960 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c5878-fc2e-4b15-9eda-196a0da0f38a None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:35.777268 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c5878-fc2e-4b15-9eda-196a0da0f38a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:35.778106 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:35.778641 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c5878-fc2e-4b15-9eda-196a0da0f38a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:35.788086 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 280/563] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:35.789341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424d843-ecc7-42ad-9040-233b31721e73 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:35.789628 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424d843-ecc7-42ad-9040-233b31721e73 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:35.789907 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424d843-ecc7-42ad-9040-233b31721e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:35.807074 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e424d843-ecc7-42ad-9040-233b31721e73 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:35.808214 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e424d843-ecc7-42ad-9040-233b31721e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:35.811091 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:35.861196 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd7e34-7dd1-4b7e-b712-3d651a8a40ea None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:35.879390 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 281/564] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:35.880585 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424d843-ecc7-42ad-9040-233b31721e73 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:35.911560 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c62eda-ac5c-4ae3-8e78-402de27ae166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:35.912723 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c62eda-ac5c-4ae3-8e78-402de27ae166 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:35.913160 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c62eda-ac5c-4ae3-8e78-402de27ae166 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:35.913585 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c62eda-ac5c-4ae3-8e78-402de27ae166 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:35.920988 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c62eda-ac5c-4ae3-8e78-402de27ae166 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:35.922745 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c62eda-ac5c-4ae3-8e78-402de27ae166 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-36c62eda-ac5c-4ae3-8e78-402de27ae166 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:35.937236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:35.938148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:35.939032 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:35.939032 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:35.939032 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:35.939032 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:35.939032 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:35.939032 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:35.939032 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:35.939032 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:35.939032 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 284/565] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:35.939529 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c62eda-ac5c-4ae3-8e78-402de27ae166 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:36.001285 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424d843-ecc7-42ad-9040-233b31721e73 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:36.040409 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:36.043901 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18ceee-48a7-4a8a-87d0-1d615a1d322d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:36.044700 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ceee-48a7-4a8a-87d0-1d615a1d322d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:36.044983 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ceee-48a7-4a8a-87d0-1d615a1d322d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:36.045257 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ceee-48a7-4a8a-87d0-1d615a1d322d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:36.053266 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c62eda-ac5c-4ae3-8e78-402de27ae166 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:36.054527 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18ceee-48a7-4a8a-87d0-1d615a1d322d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:36.056036 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18ceee-48a7-4a8a-87d0-1d615a1d322d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:36.059304 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3c18ceee-48a7-4a8a-87d0-1d615a1d322d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:36.071941 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:36.072909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:36.078888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:36.078888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:36.078888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:36.078888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:36.078888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:36.078888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:36.078888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:36.078888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:36.078888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:51:36.078888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:36.078888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 282/566] 10.222.0.43 () {56 vars in 1093 bytes} [Wed May 25 13:51:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:36.078888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18ceee-48a7-4a8a-87d0-1d615a1d322d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:36.094971 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826af2d-e3fc-4bdf-a936-afe7c5783eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:36.095792 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826af2d-e3fc-4bdf-a936-afe7c5783eea None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:36.096080 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826af2d-e3fc-4bdf-a936-afe7c5783eea None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:36.097117 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826af2d-e3fc-4bdf-a936-afe7c5783eea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:36.107436 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826af2d-e3fc-4bdf-a936-afe7c5783eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:36.109013 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826af2d-e3fc-4bdf-a936-afe7c5783eea None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a826af2d-e3fc-4bdf-a936-afe7c5783eea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:36.128404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:36.129331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:36.130214 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:36.130214 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:36.130214 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:36.130214 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:36.130214 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 285/567] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:36.130494 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826af2d-e3fc-4bdf-a936-afe7c5783eea None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:36.190907 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18ceee-48a7-4a8a-87d0-1d615a1d322d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:36.227701 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8565d62-c33d-4818-a81d-e08488bef736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:36.228550 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8565d62-c33d-4818-a81d-e08488bef736 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:36.228851 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8565d62-c33d-4818-a81d-e08488bef736 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:36.229112 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8565d62-c33d-4818-a81d-e08488bef736 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:36.234253 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826af2d-e3fc-4bdf-a936-afe7c5783eea None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:36.242083 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8565d62-c33d-4818-a81d-e08488bef736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d8565d62-c33d-4818-a81d-e08488bef736 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:36.249984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:36.250944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:36.251825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:36.251825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:36.251825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:36.251825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:36.251825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:36.251825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:36.251825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:36.251825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:36.251825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:36.251825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:36.251825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:36.251825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:36.251825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 283/568] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:36.253033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8565d62-c33d-4818-a81d-e08488bef736 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:36.277738 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824212ec-6efe-4e8a-91b6-bbd0aaadf98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:36.278432 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824212ec-6efe-4e8a-91b6-bbd0aaadf98f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:36.278717 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824212ec-6efe-4e8a-91b6-bbd0aaadf98f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:36.281779 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824212ec-6efe-4e8a-91b6-bbd0aaadf98f None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:36.282595 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824212ec-6efe-4e8a-91b6-bbd0aaadf98f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:36.282909 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824212ec-6efe-4e8a-91b6-bbd0aaadf98f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:36.284442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824212ec-6efe-4e8a-91b6-bbd0aaadf98f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:36.299410 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:36.299652 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 286/569] 10.222.0.43 () {56 vars in 1148 bytes} [Wed May 25 13:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:36.301033 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824212ec-6efe-4e8a-91b6-bbd0aaadf98f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:36.326817 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:36.367923 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8565d62-c33d-4818-a81d-e08488bef736 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:36.405579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b3796-a241-47ce-9e7e-4ac67d7d853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:36.406250 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b3796-a241-47ce-9e7e-4ac67d7d853b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:36.406527 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b3796-a241-47ce-9e7e-4ac67d7d853b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:36.406798 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b3796-a241-47ce-9e7e-4ac67d7d853b None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:36.406994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824212ec-6efe-4e8a-91b6-bbd0aaadf98f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:36.407636 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b3796-a241-47ce-9e7e-4ac67d7d853b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:36.407993 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b3796-a241-47ce-9e7e-4ac67d7d853b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:36.409461 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b3796-a241-47ce-9e7e-4ac67d7d853b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:36.426974 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 284/570] 10.222.0.43 () {56 vars in 1133 bytes} [Wed May 25 13:51:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:36.427813 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b3796-a241-47ce-9e7e-4ac67d7d853b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:36.441538 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff986c54-8a29-4d3e-8a19-81f96e96d539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:36.442193 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff986c54-8a29-4d3e-8a19-81f96e96d539 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:36.442476 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff986c54-8a29-4d3e-8a19-81f96e96d539 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:36.442754 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff986c54-8a29-4d3e-8a19-81f96e96d539 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:36.443472 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff986c54-8a29-4d3e-8a19-81f96e96d539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:36.443811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff986c54-8a29-4d3e-8a19-81f96e96d539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:36.445187 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff986c54-8a29-4d3e-8a19-81f96e96d539 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:36.457059 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 287/571] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:36.457847 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff986c54-8a29-4d3e-8a19-81f96e96d539 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:36.514959 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:36.534901 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b3796-a241-47ce-9e7e-4ac67d7d853b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:36.553046 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:36.554197 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff986c54-8a29-4d3e-8a19-81f96e96d539 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:36.570252 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba938932-f8c3-477a-a862-9396b0c287b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:36.570944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba938932-f8c3-477a-a862-9396b0c287b4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:36.571232 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba938932-f8c3-477a-a862-9396b0c287b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:36.571514 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba938932-f8c3-477a-a862-9396b0c287b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:36.572307 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba938932-f8c3-477a-a862-9396b0c287b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:36.572624 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba938932-f8c3-477a-a862-9396b0c287b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:36.573994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba938932-f8c3-477a-a862-9396b0c287b4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:36.584081 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 285/572] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:36.585502 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d40f2-a2eb-40d0-a45e-490deb1d7c13 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:36.586121 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d40f2-a2eb-40d0-a45e-490deb1d7c13 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:36.586410 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d40f2-a2eb-40d0-a45e-490deb1d7c13 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:36.587673 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 286/573] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:36.588458 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d40f2-a2eb-40d0-a45e-490deb1d7c13 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:36.590656 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dc8aa-19d3-4c71-b9fa-f2f28d5c9db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:36.591641 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dc8aa-19d3-4c71-b9fa-f2f28d5c9db0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:36.592115 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dc8aa-19d3-4c71-b9fa-f2f28d5c9db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:36.593199 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dc8aa-19d3-4c71-b9fa-f2f28d5c9db0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:36.594031 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dc8aa-19d3-4c71-b9fa-f2f28d5c9db0 None admin] RBAC: Adding query filter params (role.id=97c702855bb64e118e62642a59a444b9, scope.project.id=8686972299d942168ba6ed9c25bf6ec9, user.id=d2abda8aa7344dd5bc53365dc6b8d261) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:36.594346 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dc8aa-19d3-4c71-b9fa-f2f28d5c9db0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:36.595825 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dc8aa-19d3-4c71-b9fa-f2f28d5c9db0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:36.602030 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 288/574] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:51:36 2022] GET /identity/v3/role_assignments?user.id=d2abda8aa7344dd5bc53365dc6b8d261&scope.project.id=8686972299d942168ba6ed9c25bf6ec9&role.id=97c702855bb64e118e62642a59a444b9 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:36.602826 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dc8aa-19d3-4c71-b9fa-f2f28d5c9db0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:36.711838 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d40f2-a2eb-40d0-a45e-490deb1d7c13 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:36.727922 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dc8aa-19d3-4c71-b9fa-f2f28d5c9db0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:36.753522 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852fdc0-6e28-431e-9d7c-a38c23c28b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:36.754332 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852fdc0-6e28-431e-9d7c-a38c23c28b40 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:36.754615 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852fdc0-6e28-431e-9d7c-a38c23c28b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:36.754923 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852fdc0-6e28-431e-9d7c-a38c23c28b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:36.755528 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:36.766868 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852fdc0-6e28-431e-9d7c-a38c23c28b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:36.767077 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52a439-4410-4337-a319-d5e5a051f675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:36.767841 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52a439-4410-4337-a319-d5e5a051f675 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:36.769016 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52a439-4410-4337-a319-d5e5a051f675 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:36.769143 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852fdc0-6e28-431e-9d7c-a38c23c28b40 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:36.769220 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52a439-4410-4337-a319-d5e5a051f675 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:36.777493 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52a439-4410-4337-a319-d5e5a051f675 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:36.778985 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52a439-4410-4337-a319-d5e5a051f675 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6852fdc0-6e28-431e-9d7c-a38c23c28b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:36.788599 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:36.789609 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:36.790513 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:36.790513 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:36.790513 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:36.790513 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:36.792150 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 287/575] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:36.793565 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fd78d-45fb-42b6-9393-131558b613f5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:36.793985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fd78d-45fb-42b6-9393-131558b613f5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:36.794403 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fd78d-45fb-42b6-9393-131558b613f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-ad52a439-4410-4337-a319-d5e5a051f675 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:36.794575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:36.795453 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:36.796527 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:36.796527 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:36.796527 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:36.796527 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:36.796527 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:36.796527 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:36.796527 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:36.796527 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:36.796527 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:51:36.796527 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:36.800355 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 289/576] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:36.801223 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52a439-4410-4337-a319-d5e5a051f675 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:36.816386 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-155fd78d-45fb-42b6-9393-131558b613f5 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:36.817570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-155fd78d-45fb-42b6-9393-131558b613f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:36.846558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:36.896173 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 288/577] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:36.897632 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fd78d-45fb-42b6-9393-131558b613f5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:37.023059 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fd78d-45fb-42b6-9393-131558b613f5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:37.036965 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52a439-4410-4337-a319-d5e5a051f675 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:37.061201 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9f11e-9faf-4ead-a1f6-4d3e12aa26b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:37.061864 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9f11e-9faf-4ead-a1f6-4d3e12aa26b8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:37.062178 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9f11e-9faf-4ead-a1f6-4d3e12aa26b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:37.062461 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9f11e-9faf-4ead-a1f6-4d3e12aa26b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:37.063181 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9f11e-9faf-4ead-a1f6-4d3e12aa26b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:37.063490 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9f11e-9faf-4ead-a1f6-4d3e12aa26b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:37.064909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9f11e-9faf-4ead-a1f6-4d3e12aa26b8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:37.077214 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 289/578] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:37.078038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9f11e-9faf-4ead-a1f6-4d3e12aa26b8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:37.079282 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bf2c5-5d6e-4aa0-a3a9-386a8adac9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:37.080293 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf2c5-5d6e-4aa0-a3a9-386a8adac9ef None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:37.081533 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf2c5-5d6e-4aa0-a3a9-386a8adac9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:37.082444 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf2c5-5d6e-4aa0-a3a9-386a8adac9ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:37.094008 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bf2c5-5d6e-4aa0-a3a9-386a8adac9ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:37.095615 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bf2c5-5d6e-4aa0-a3a9-386a8adac9ef None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:37.105714 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e29bf2c5-5d6e-4aa0-a3a9-386a8adac9ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:37.119905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:37.120829 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:37.121688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:37.121688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:37.121688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:37.121688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:37.121688 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 290/579] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:37.122479 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bf2c5-5d6e-4aa0-a3a9-386a8adac9ef None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:37.161084 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:37.189564 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9f11e-9faf-4ead-a1f6-4d3e12aa26b8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:37.230152 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb7bfd-dc31-4244-9403-cbeaf8b028d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:37.230578 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bf2c5-5d6e-4aa0-a3a9-386a8adac9ef None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:37.230825 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb7bfd-dc31-4244-9403-cbeaf8b028d1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:37.231110 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb7bfd-dc31-4244-9403-cbeaf8b028d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:37.231391 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb7bfd-dc31-4244-9403-cbeaf8b028d1 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:37.232258 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb7bfd-dc31-4244-9403-cbeaf8b028d1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:37.232570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb7bfd-dc31-4244-9403-cbeaf8b028d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:37.234020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb7bfd-dc31-4244-9403-cbeaf8b028d1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:37.259128 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 290/580] 10.222.0.43 () {56 vars in 1137 bytes} [Wed May 25 13:51:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:37.259128 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb7bfd-dc31-4244-9403-cbeaf8b028d1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:37.274597 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50f673-eb37-4944-b403-f526124249c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:37.275414 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50f673-eb37-4944-b403-f526124249c2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:37.275670 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50f673-eb37-4944-b403-f526124249c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:37.276038 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50f673-eb37-4944-b403-f526124249c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:37.287259 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50f673-eb37-4944-b403-f526124249c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4f50f673-eb37-4944-b403-f526124249c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:37.295009 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:37.296058 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:37.303567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:37.303567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:37.303567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:37.303567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:37.303567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:37.303567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:37.303567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:37.303567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:37.303567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:37.303567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:37.303567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:37.303567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:37.303567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 291/581] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:37.303567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50f673-eb37-4944-b403-f526124249c2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:37.360353 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:37.388106 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb7bfd-dc31-4244-9403-cbeaf8b028d1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:37.412897 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:37.419257 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50f673-eb37-4944-b403-f526124249c2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:37.426567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9173654-8c60-45df-a122-dc863bc068a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:37.427376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173654-8c60-45df-a122-dc863bc068a1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:37.427662 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173654-8c60-45df-a122-dc863bc068a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:37.427978 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173654-8c60-45df-a122-dc863bc068a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:37.434842 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9173654-8c60-45df-a122-dc863bc068a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:37.436351 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9173654-8c60-45df-a122-dc863bc068a1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f9173654-8c60-45df-a122-dc863bc068a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:37.450333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:37.451253 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:37.452148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:37.452148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:37.452148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:37.452148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:37.452148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:37.452148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:37.452148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:37.452148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:37.452148 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 291/582] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:37.453239 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9173654-8c60-45df-a122-dc863bc068a1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:37.457849 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4d33-e0fc-46bb-a5d7-19d49ed5eafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:37.459205 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4d33-e0fc-46bb-a5d7-19d49ed5eafc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:37.459205 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4d33-e0fc-46bb-a5d7-19d49ed5eafc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:37.459205 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4d33-e0fc-46bb-a5d7-19d49ed5eafc None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:37.459998 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed4d33-e0fc-46bb-a5d7-19d49ed5eafc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:37.460311 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed4d33-e0fc-46bb-a5d7-19d49ed5eafc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:37.461702 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed4d33-e0fc-46bb-a5d7-19d49ed5eafc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:37.474936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 292/583] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:37.475900 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4d33-e0fc-46bb-a5d7-19d49ed5eafc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:37.558635 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9173654-8c60-45df-a122-dc863bc068a1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:37.580896 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4d33-e0fc-46bb-a5d7-19d49ed5eafc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:37.594261 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99085449-8b03-4cd5-ba00-9b9dfb712984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:37.597327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99085449-8b03-4cd5-ba00-9b9dfb712984 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:37.597327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99085449-8b03-4cd5-ba00-9b9dfb712984 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:37.597327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99085449-8b03-4cd5-ba00-9b9dfb712984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:37.606852 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:37.609440 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99085449-8b03-4cd5-ba00-9b9dfb712984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:37.610942 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99085449-8b03-4cd5-ba00-9b9dfb712984 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:37.617758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6c59-7ef6-4fa0-b41a-fa784374cb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:37.620489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6c59-7ef6-4fa0-b41a-fa784374cb54 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:37.620489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6c59-7ef6-4fa0-b41a-fa784374cb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:37.620489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6c59-7ef6-4fa0-b41a-fa784374cb54 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:37.620489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb6c59-7ef6-4fa0-b41a-fa784374cb54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:37.620489 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb6c59-7ef6-4fa0-b41a-fa784374cb54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:37.621419 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb6c59-7ef6-4fa0-b41a-fa784374cb54 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-99085449-8b03-4cd5-ba00-9b9dfb712984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:37.638159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:37.639376 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:37.649341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:37.649341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:37.649341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:37.649341 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:37.649635 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 293/584] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:37.649635 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6c59-7ef6-4fa0-b41a-fa784374cb54 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:37.649808 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 292/585] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:37.649808 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99085449-8b03-4cd5-ba00-9b9dfb712984 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:37.706059 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:37.794639 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99085449-8b03-4cd5-ba00-9b9dfb712984 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:37.798275 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6c59-7ef6-4fa0-b41a-fa784374cb54 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:37.833450 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c029f7f-8f9b-4bb3-9e77-242e8d49d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:37.834242 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c029f7f-8f9b-4bb3-9e77-242e8d49d8eb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:37.834523 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c029f7f-8f9b-4bb3-9e77-242e8d49d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:37.834793 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c029f7f-8f9b-4bb3-9e77-242e8d49d8eb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:37.835340 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c6775-2aaf-490e-bc2f-7f1cc94e4564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:37.836027 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c6775-2aaf-490e-bc2f-7f1cc94e4564 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:37.836313 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c6775-2aaf-490e-bc2f-7f1cc94e4564 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:37.836583 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c6775-2aaf-490e-bc2f-7f1cc94e4564 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:37.837376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c6775-2aaf-490e-bc2f-7f1cc94e4564 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:37.837691 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c6775-2aaf-490e-bc2f-7f1cc94e4564 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:37.839394 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c6775-2aaf-490e-bc2f-7f1cc94e4564 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:37.843129 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c029f7f-8f9b-4bb3-9e77-242e8d49d8eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:37.844583 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c029f7f-8f9b-4bb3-9e77-242e8d49d8eb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:37.852496 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 294/586] 10.222.0.43 () {56 vars in 1148 bytes} [Wed May 25 13:51:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:37.857203 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c6775-2aaf-490e-bc2f-7f1cc94e4564 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7c029f7f-8f9b-4bb3-9e77-242e8d49d8eb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:37.860177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:37.861146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:37.862756 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:37.862756 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:37.862756 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:37.862756 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:37.862756 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:37.862756 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:37.862756 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:37.862756 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:37.862756 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 13:51:37.862756 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:37.862756 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 293/587] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:37.863366 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c029f7f-8f9b-4bb3-9e77-242e8d49d8eb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:37.919428 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:37.943745 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:37.966103 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c6775-2aaf-490e-bc2f-7f1cc94e4564 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:37.969909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c029f7f-8f9b-4bb3-9e77-242e8d49d8eb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:38.001983 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6cdc3-cb5e-4e7e-bd0f-d372fe0f0207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:38.002563 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6cdc3-cb5e-4e7e-bd0f-d372fe0f0207 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:38.003201 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6cdc3-cb5e-4e7e-bd0f-d372fe0f0207 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:38.003201 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6cdc3-cb5e-4e7e-bd0f-d372fe0f0207 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:38.003911 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6cdc3-cb5e-4e7e-bd0f-d372fe0f0207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:38.004284 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6cdc3-cb5e-4e7e-bd0f-d372fe0f0207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:38.005671 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6cdc3-cb5e-4e7e-bd0f-d372fe0f0207 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:38.007559 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d696926-135f-4406-a255-1fe53b060678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:38.008383 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d696926-135f-4406-a255-1fe53b060678 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:38.008671 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d696926-135f-4406-a255-1fe53b060678 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:38.008950 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d696926-135f-4406-a255-1fe53b060678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:38.022936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 295/588] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:38.022936 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6cdc3-cb5e-4e7e-bd0f-d372fe0f0207 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:38.023213 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d696926-135f-4406-a255-1fe53b060678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:38.023213 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d696926-135f-4406-a255-1fe53b060678 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6d696926-135f-4406-a255-1fe53b060678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:38.041255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:38.042212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:38.043184 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:38.043184 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:38.043184 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:38.043184 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:38.043184 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 294/589] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:38.043487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d696926-135f-4406-a255-1fe53b060678 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:38.135606 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6cdc3-cb5e-4e7e-bd0f-d372fe0f0207 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:38.150215 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d696926-135f-4406-a255-1fe53b060678 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:38.152681 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:38.170841 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a6ce7-349c-461e-bf23-45cb6abce480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:38.171742 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a6ce7-349c-461e-bf23-45cb6abce480 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:38.172035 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a6ce7-349c-461e-bf23-45cb6abce480 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:38.172307 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a6ce7-349c-461e-bf23-45cb6abce480 None admin] PATH_INFO: `/v3/projects/8686972299d942168ba6ed9c25bf6ec9/users/c1dc40f3b4a942f9b52ec74452309aac/roles/97c702855bb64e118e62642a59a444b9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:38.181366 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:38.187482 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584019f0-b78d-4cab-918c-b6e92fa715f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:38.188183 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584019f0-b78d-4cab-918c-b6e92fa715f9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:38.188473 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584019f0-b78d-4cab-918c-b6e92fa715f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:38.188587 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a6ce7-349c-461e-bf23-45cb6abce480 None admin] RBAC: Authorizing `identity:create_grant(project_id=8686972299d942168ba6ed9c25bf6ec9, user_id=c1dc40f3b4a942f9b52ec74452309aac, role_id=97c702855bb64e118e62642a59a444b9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:38.188748 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584019f0-b78d-4cab-918c-b6e92fa715f9 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:38.189587 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584019f0-b78d-4cab-918c-b6e92fa715f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:38.189975 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584019f0-b78d-4cab-918c-b6e92fa715f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:38.190818 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a6ce7-349c-461e-bf23-45cb6abce480 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:38.192233 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584019f0-b78d-4cab-918c-b6e92fa715f9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:38.210132 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 295/590] 10.222.0.43 () {56 vars in 1137 bytes} [Wed May 25 13:51:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:38.214777 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584019f0-b78d-4cab-918c-b6e92fa715f9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:38.279745 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 296/591] 10.222.0.43 () {58 vars in 1439 bytes} [Wed May 25 13:51:38 2022] PUT /identity/v3/projects/8686972299d942168ba6ed9c25bf6ec9/users/c1dc40f3b4a942f9b52ec74452309aac/roles/97c702855bb64e118e62642a59a444b9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:38.279745 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a6ce7-349c-461e-bf23-45cb6abce480 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:38.335105 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584019f0-b78d-4cab-918c-b6e92fa715f9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:38.373317 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311db5b-22eb-40da-84a2-af2ee1eb8c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:38.374126 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311db5b-22eb-40da-84a2-af2ee1eb8c7b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:38.374410 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311db5b-22eb-40da-84a2-af2ee1eb8c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:38.374683 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311db5b-22eb-40da-84a2-af2ee1eb8c7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:38.383161 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311db5b-22eb-40da-84a2-af2ee1eb8c7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:38.384667 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311db5b-22eb-40da-84a2-af2ee1eb8c7b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f311db5b-22eb-40da-84a2-af2ee1eb8c7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:38.400919 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:38.401866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:38.402767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:38.402767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:38.402767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:38.402767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:38.402767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:38.402767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:38.402767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:38.402767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:38.402767 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 296/592] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:38.403285 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311db5b-22eb-40da-84a2-af2ee1eb8c7b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:38.431535 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:38.441513 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a6ce7-349c-461e-bf23-45cb6abce480 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:38.493929 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54918f-6dfd-4bbd-86da-998b206075c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:38.495451 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54918f-6dfd-4bbd-86da-998b206075c8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:38.495979 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54918f-6dfd-4bbd-86da-998b206075c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:38.496472 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54918f-6dfd-4bbd-86da-998b206075c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:38.497871 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54918f-6dfd-4bbd-86da-998b206075c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:38.498556 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54918f-6dfd-4bbd-86da-998b206075c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:38.500650 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54918f-6dfd-4bbd-86da-998b206075c8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:38.519257 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 297/593] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:38.520746 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54918f-6dfd-4bbd-86da-998b206075c8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:38.527019 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311db5b-22eb-40da-84a2-af2ee1eb8c7b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:38.578563 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f251c13-b53e-4a17-96d1-2fe7d17541f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:38.579356 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251c13-b53e-4a17-96d1-2fe7d17541f6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:38.579642 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251c13-b53e-4a17-96d1-2fe7d17541f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:38.579948 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251c13-b53e-4a17-96d1-2fe7d17541f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:38.582893 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:38.597003 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f251c13-b53e-4a17-96d1-2fe7d17541f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:38.598520 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f251c13-b53e-4a17-96d1-2fe7d17541f6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0f251c13-b53e-4a17-96d1-2fe7d17541f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:38.616915 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:38.617863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:38.618765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:38.618765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:38.618765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:38.618765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:38.618765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 297/594] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:38.619469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f251c13-b53e-4a17-96d1-2fe7d17541f6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:38.646507 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54918f-6dfd-4bbd-86da-998b206075c8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:38.692491 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e98e06-68fc-48f5-9cf7-c8592e751cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:38.693073 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e98e06-68fc-48f5-9cf7-c8592e751cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:38.693355 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e98e06-68fc-48f5-9cf7-c8592e751cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:38.693630 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e98e06-68fc-48f5-9cf7-c8592e751cc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:38.694437 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e98e06-68fc-48f5-9cf7-c8592e751cc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:38.694756 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e98e06-68fc-48f5-9cf7-c8592e751cc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:38.696331 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e98e06-68fc-48f5-9cf7-c8592e751cc4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:38.715240 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 298/595] 10.222.0.43 () {56 vars in 1148 bytes} [Wed May 25 13:51:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:38.716873 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e98e06-68fc-48f5-9cf7-c8592e751cc4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:38.722775 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:38.750643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f251c13-b53e-4a17-96d1-2fe7d17541f6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:38.788617 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f7379-a71e-499d-a608-ee17bf6d5568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:38.789808 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f7379-a71e-499d-a608-ee17bf6d5568 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:38.790318 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f7379-a71e-499d-a608-ee17bf6d5568 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:38.790796 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f7379-a71e-499d-a608-ee17bf6d5568 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:38.798618 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f7379-a71e-499d-a608-ee17bf6d5568 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:38.800973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f7379-a71e-499d-a608-ee17bf6d5568 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3c8f7379-a71e-499d-a608-ee17bf6d5568 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:38.818038 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:38.819045 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:38.820012 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:38.820012 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:38.820012 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:38.820012 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:38.820012 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:38.820012 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:38.820012 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:38.820012 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:38.820012 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:51:38.820012 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:38.822643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 298/596] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:38.823679 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f7379-a71e-499d-a608-ee17bf6d5568 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:38.824501 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e98e06-68fc-48f5-9cf7-c8592e751cc4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:38.835593 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:38.863377 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe0426-425a-4812-900b-c98d0c790612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:38.864396 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe0426-425a-4812-900b-c98d0c790612 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:38.864695 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe0426-425a-4812-900b-c98d0c790612 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:38.865099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe0426-425a-4812-900b-c98d0c790612 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:38.865895 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe0426-425a-4812-900b-c98d0c790612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:38.866715 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe0426-425a-4812-900b-c98d0c790612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:38.868975 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe0426-425a-4812-900b-c98d0c790612 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:38.881430 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 299/597] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:38.882240 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe0426-425a-4812-900b-c98d0c790612 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:38.945560 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f7379-a71e-499d-a608-ee17bf6d5568 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:38.984350 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2ae51-0114-475d-b6e3-bd87963c0b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:38.985290 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2ae51-0114-475d-b6e3-bd87963c0b7d None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:38.985626 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2ae51-0114-475d-b6e3-bd87963c0b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:38.985732 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe0426-425a-4812-900b-c98d0c790612 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:38.985912 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2ae51-0114-475d-b6e3-bd87963c0b7d None admin] PATH_INFO: `/v3/projects/8686972299d942168ba6ed9c25bf6ec9/users/1cb9736c4af44cc0aa1f32878081baff/roles/97c702855bb64e118e62642a59a444b9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:38.989619 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:39.003660 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2ae51-0114-475d-b6e3-bd87963c0b7d None admin] RBAC: Authorizing `identity:create_grant(project_id=8686972299d942168ba6ed9c25bf6ec9, user_id=1cb9736c4af44cc0aa1f32878081baff, role_id=97c702855bb64e118e62642a59a444b9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:39.005229 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2ae51-0114-475d-b6e3-bd87963c0b7d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:39.019637 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f9fb6-01fe-46a2-b7e2-f8c43c581c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:39.020337 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f9fb6-01fe-46a2-b7e2-f8c43c581c23 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:39.020622 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f9fb6-01fe-46a2-b7e2-f8c43c581c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:39.020899 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f9fb6-01fe-46a2-b7e2-f8c43c581c23 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:39.021732 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f9fb6-01fe-46a2-b7e2-f8c43c581c23 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:39.022042 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f9fb6-01fe-46a2-b7e2-f8c43c581c23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:39.023469 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f9fb6-01fe-46a2-b7e2-f8c43c581c23 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:39.040991 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 300/598] 10.222.0.43 () {56 vars in 1139 bytes} [Wed May 25 13:51:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:39.042272 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bce5b-996e-48c4-a676-66afbcdc0a76 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:39.042561 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bce5b-996e-48c4-a676-66afbcdc0a76 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:39.042840 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bce5b-996e-48c4-a676-66afbcdc0a76 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:39.046085 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 301/599] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:39.046085 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bce5b-996e-48c4-a676-66afbcdc0a76 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:39.072617 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:39.102753 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 299/600] 10.222.0.43 () {58 vars in 1439 bytes} [Wed May 25 13:51:38 2022] PUT /identity/v3/projects/8686972299d942168ba6ed9c25bf6ec9/users/1cb9736c4af44cc0aa1f32878081baff/roles/97c702855bb64e118e62642a59a444b9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:39.103971 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2ae51-0114-475d-b6e3-bd87963c0b7d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:39.165797 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bce5b-996e-48c4-a676-66afbcdc0a76 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:39.218994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642c18a-6957-4f9d-b2ef-e50945b0cf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:39.220235 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c18a-6957-4f9d-b2ef-e50945b0cf5e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:39.220523 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c18a-6957-4f9d-b2ef-e50945b0cf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:39.220803 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c18a-6957-4f9d-b2ef-e50945b0cf5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:39.230802 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642c18a-6957-4f9d-b2ef-e50945b0cf5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:39.232495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642c18a-6957-4f9d-b2ef-e50945b0cf5e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:39.248768 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2ae51-0114-475d-b6e3-bd87963c0b7d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7642c18a-6957-4f9d-b2ef-e50945b0cf5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:39.251138 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:39.252242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:39.253695 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:39.253695 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:39.253695 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:39.253695 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:39.253695 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:39.253695 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:39.253695 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:39.253695 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:39.256152 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 302/601] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:39.257682 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c0d3f-736b-40c5-b309-fd356afbcd0d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:39.258148 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c0d3f-736b-40c5-b309-fd356afbcd0d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:39.258611 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c0d3f-736b-40c5-b309-fd356afbcd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:39.277120 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f81c0d3f-736b-40c5-b309-fd356afbcd0d None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:39.278668 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f81c0d3f-736b-40c5-b309-fd356afbcd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:39.310209 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204d8bb-2ae1-4360-8191-2e2be194c523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:39.311273 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204d8bb-2ae1-4360-8191-2e2be194c523 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:39.311554 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204d8bb-2ae1-4360-8191-2e2be194c523 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:39.312285 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204d8bb-2ae1-4360-8191-2e2be194c523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:39.327427 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204d8bb-2ae1-4360-8191-2e2be194c523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:39.329283 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204d8bb-2ae1-4360-8191-2e2be194c523 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1204d8bb-2ae1-4360-8191-2e2be194c523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:39.353075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:39.354015 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:39.354888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:39.354888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:39.354888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:39.354888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:39.354888 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 300/602] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:39.355984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204d8bb-2ae1-4360-8191-2e2be194c523 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:39.379857 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 303/603] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:39.380844 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c0d3f-736b-40c5-b309-fd356afbcd0d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:39.395383 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:39.402797 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:39.464444 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204d8bb-2ae1-4360-8191-2e2be194c523 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:39.504064 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c8aed-0242-44f0-8bc0-9d357a95447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:39.504650 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c8aed-0242-44f0-8bc0-9d357a95447f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:39.504932 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c8aed-0242-44f0-8bc0-9d357a95447f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:39.505208 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c8aed-0242-44f0-8bc0-9d357a95447f None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:39.505813 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c0d3f-736b-40c5-b309-fd356afbcd0d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:39.506144 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c8aed-0242-44f0-8bc0-9d357a95447f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:39.506459 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c8aed-0242-44f0-8bc0-9d357a95447f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:39.508042 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c8aed-0242-44f0-8bc0-9d357a95447f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:39.528272 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 301/604] 10.222.0.43 () {56 vars in 1148 bytes} [Wed May 25 13:51:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:39.534020 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c8aed-0242-44f0-8bc0-9d357a95447f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:39.544990 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40188c0-eb0b-4189-8917-9ee8ea0ba982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:39.545658 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40188c0-eb0b-4189-8917-9ee8ea0ba982 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:39.546068 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40188c0-eb0b-4189-8917-9ee8ea0ba982 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:39.546347 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40188c0-eb0b-4189-8917-9ee8ea0ba982 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:39.547064 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40188c0-eb0b-4189-8917-9ee8ea0ba982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:39.547478 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40188c0-eb0b-4189-8917-9ee8ea0ba982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:39.551024 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40188c0-eb0b-4189-8917-9ee8ea0ba982 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:39.564280 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 304/605] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:39.565421 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40188c0-eb0b-4189-8917-9ee8ea0ba982 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:39.642063 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:39.648632 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c8aed-0242-44f0-8bc0-9d357a95447f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:39.652827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:39.679466 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40188c0-eb0b-4189-8917-9ee8ea0ba982 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:39.687142 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d928e29-9216-4818-b9c5-f8ebd4f1865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:39.688026 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d928e29-9216-4818-b9c5-f8ebd4f1865f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:39.688310 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d928e29-9216-4818-b9c5-f8ebd4f1865f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:39.688586 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d928e29-9216-4818-b9c5-f8ebd4f1865f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:39.701329 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d928e29-9216-4818-b9c5-f8ebd4f1865f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0d928e29-9216-4818-b9c5-f8ebd4f1865f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:39.714481 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:39.716674 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:39.718668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:39.718668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:39.718668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:39.718668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:39.718668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:39.718668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:39.718668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:39.718668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:39.718668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:39.718668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:39.718668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:39.718668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:39.718668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 302/606] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:39.718668 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d928e29-9216-4818-b9c5-f8ebd4f1865f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:39.731843 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e87fb-9ef0-42f1-8fc2-53a7c3412757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:39.732750 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e87fb-9ef0-42f1-8fc2-53a7c3412757 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:39.733089 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e87fb-9ef0-42f1-8fc2-53a7c3412757 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:39.733365 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e87fb-9ef0-42f1-8fc2-53a7c3412757 None admin] PATH_INFO: `/v3/projects/8686972299d942168ba6ed9c25bf6ec9/users/67f88f575ce742d584db7fa53d986143/roles/97c702855bb64e118e62642a59a444b9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:39.749455 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e87fb-9ef0-42f1-8fc2-53a7c3412757 None admin] RBAC: Authorizing `identity:create_grant(project_id=8686972299d942168ba6ed9c25bf6ec9, user_id=67f88f575ce742d584db7fa53d986143, role_id=97c702855bb64e118e62642a59a444b9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:39.750899 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e87fb-9ef0-42f1-8fc2-53a7c3412757 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:39.825782 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d928e29-9216-4818-b9c5-f8ebd4f1865f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:39.853370 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 305/607] 10.222.0.43 () {58 vars in 1439 bytes} [Wed May 25 13:51:39 2022] PUT /identity/v3/projects/8686972299d942168ba6ed9c25bf6ec9/users/67f88f575ce742d584db7fa53d986143/roles/97c702855bb64e118e62642a59a444b9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:39.854011 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e87fb-9ef0-42f1-8fc2-53a7c3412757 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:39.884498 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d306172-1d68-4852-b31b-ebc4fb3134f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:39.886533 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306172-1d68-4852-b31b-ebc4fb3134f5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:39.887091 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306172-1d68-4852-b31b-ebc4fb3134f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:39.887368 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306172-1d68-4852-b31b-ebc4fb3134f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:39.904922 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d306172-1d68-4852-b31b-ebc4fb3134f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:39.908126 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d306172-1d68-4852-b31b-ebc4fb3134f5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4d306172-1d68-4852-b31b-ebc4fb3134f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:39.939773 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:39.941243 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:39.942195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:39.942195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:39.942195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:39.942195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:39.942195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:39.942195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:39.942195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:39.942195 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:39.943134 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 303/608] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:39.950349 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d306172-1d68-4852-b31b-ebc4fb3134f5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:39.984117 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:40.100293 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d306172-1d68-4852-b31b-ebc4fb3134f5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:40.121141 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e87fb-9ef0-42f1-8fc2-53a7c3412757 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:40.146033 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c9f46-5c1c-4507-bfaf-5b93f9b6d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:40.146696 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c9f46-5c1c-4507-bfaf-5b93f9b6d831 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:40.146979 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c9f46-5c1c-4507-bfaf-5b93f9b6d831 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:40.147254 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c9f46-5c1c-4507-bfaf-5b93f9b6d831 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:40.148075 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c9f46-5c1c-4507-bfaf-5b93f9b6d831 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:40.148385 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c9f46-5c1c-4507-bfaf-5b93f9b6d831 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:40.149811 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c9f46-5c1c-4507-bfaf-5b93f9b6d831 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:40.157652 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:40.164113 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 304/609] 10.222.0.43 () {56 vars in 1148 bytes} [Wed May 25 13:51:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:40.171750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c9f46-5c1c-4507-bfaf-5b93f9b6d831 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:40.175965 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fad40-95ff-459f-babf-5ef89617ec58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:40.175965 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fad40-95ff-459f-babf-5ef89617ec58 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:40.175965 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fad40-95ff-459f-babf-5ef89617ec58 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:40.175965 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fad40-95ff-459f-babf-5ef89617ec58 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:40.176369 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fad40-95ff-459f-babf-5ef89617ec58 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:40.176369 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fad40-95ff-459f-babf-5ef89617ec58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:40.176369 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fad40-95ff-459f-babf-5ef89617ec58 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:40.203153 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 306/610] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:40.208840 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fad40-95ff-459f-babf-5ef89617ec58 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:40.260032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:40.284509 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c9f46-5c1c-4507-bfaf-5b93f9b6d831 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:40.332415 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2fc57-4e60-4f30-b00a-93f3bec05b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:40.333596 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2fc57-4e60-4f30-b00a-93f3bec05b0d None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:40.334013 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2fc57-4e60-4f30-b00a-93f3bec05b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:40.334432 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2fc57-4e60-4f30-b00a-93f3bec05b0d None admin] PATH_INFO: `/v3/projects/8686972299d942168ba6ed9c25bf6ec9/users/7c0f3b9c9a1744cc965412231e96a74c/roles/97c702855bb64e118e62642a59a444b9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:40.373373 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2fc57-4e60-4f30-b00a-93f3bec05b0d None admin] RBAC: Authorizing `identity:create_grant(project_id=8686972299d942168ba6ed9c25bf6ec9, user_id=7c0f3b9c9a1744cc965412231e96a74c, role_id=97c702855bb64e118e62642a59a444b9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:40.375089 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2fc57-4e60-4f30-b00a-93f3bec05b0d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:40.396235 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fad40-95ff-459f-babf-5ef89617ec58 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:40.432295 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5ffb0-8135-4039-847a-cc0016b4c754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:40.433132 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ffb0-8135-4039-847a-cc0016b4c754 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:40.433407 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ffb0-8135-4039-847a-cc0016b4c754 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:40.433684 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ffb0-8135-4039-847a-cc0016b4c754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:40.445202 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5ffb0-8135-4039-847a-cc0016b4c754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:40.446795 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5ffb0-8135-4039-847a-cc0016b4c754 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-28e5ffb0-8135-4039-847a-cc0016b4c754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:40.466919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:40.467973 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:40.468848 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:40.468848 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:40.468848 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:40.468848 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:40.475782 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 307/611] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:40.475782 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5ffb0-8135-4039-847a-cc0016b4c754 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:40.478588 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 305/612] 10.222.0.43 () {58 vars in 1439 bytes} [Wed May 25 13:51:40 2022] PUT /identity/v3/projects/8686972299d942168ba6ed9c25bf6ec9/users/7c0f3b9c9a1744cc965412231e96a74c/roles/97c702855bb64e118e62642a59a444b9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:40.527307 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:40.592432 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5ffb0-8135-4039-847a-cc0016b4c754 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:40.630600 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921c46f-3341-499a-aa14-397daa2a4e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:40.631200 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921c46f-3341-499a-aa14-397daa2a4e15 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:40.631482 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921c46f-3341-499a-aa14-397daa2a4e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:40.631783 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921c46f-3341-499a-aa14-397daa2a4e15 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:40.632525 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921c46f-3341-499a-aa14-397daa2a4e15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:40.632827 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921c46f-3341-499a-aa14-397daa2a4e15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:40.634298 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921c46f-3341-499a-aa14-397daa2a4e15 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:40.653555 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 308/613] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:40.654933 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2fc57-4e60-4f30-b00a-93f3bec05b0d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:40.674416 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57374f62-621d-4233-92e8-c2573bc4f3ab None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:40.674693 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57374f62-621d-4233-92e8-c2573bc4f3ab None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:40.675084 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57374f62-621d-4233-92e8-c2573bc4f3ab None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:40.676766 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 309/614] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:40.682404 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490129fd-00c2-4528-805e-45a67a4765ca None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:40.683080 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490129fd-00c2-4528-805e-45a67a4765ca None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:40.683566 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490129fd-00c2-4528-805e-45a67a4765ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:40.713120 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-490129fd-00c2-4528-805e-45a67a4765ca None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:40.716026 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-490129fd-00c2-4528-805e-45a67a4765ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:40.810626 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 310/615] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:51:40.822605 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2fc57-4e60-4f30-b00a-93f3bec05b0d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:40.836518 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490129fd-00c2-4528-805e-45a67a4765ca None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:40.855234 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:40.875531 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5be18-78c5-4b08-b090-8ccda8b7ff12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:40.876400 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5be18-78c5-4b08-b090-8ccda8b7ff12 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:40.876678 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5be18-78c5-4b08-b090-8ccda8b7ff12 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:40.876954 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5be18-78c5-4b08-b090-8ccda8b7ff12 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:40.883302 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:40.900686 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5be18-78c5-4b08-b090-8ccda8b7ff12 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:40.902152 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5be18-78c5-4b08-b090-8ccda8b7ff12 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-92f5be18-78c5-4b08-b090-8ccda8b7ff12 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:40.935263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:40.936327 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:40.937255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:40.937255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:40.937255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:40.937255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:40.937255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:40.937255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:40.937255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:40.937255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:40.937255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:51:40.937255 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:40.939320 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 306/616] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:51:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:40.944661 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5be18-78c5-4b08-b090-8ccda8b7ff12 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:41.035392 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490129fd-00c2-4528-805e-45a67a4765ca None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:41.068710 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5be18-78c5-4b08-b090-8ccda8b7ff12 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:41.109669 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cccf3-c596-4095-95d4-3dd679f9292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:41.110346 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cccf3-c596-4095-95d4-3dd679f9292d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:41.110628 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cccf3-c596-4095-95d4-3dd679f9292d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:41.110909 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cccf3-c596-4095-95d4-3dd679f9292d None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:41.112291 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cccf3-c596-4095-95d4-3dd679f9292d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:41.112596 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cccf3-c596-4095-95d4-3dd679f9292d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:41.114146 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cccf3-c596-4095-95d4-3dd679f9292d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:41.114394 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f1ea6-4908-44b7-bad4-15c2ac2efa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:41.115209 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f1ea6-4908-44b7-bad4-15c2ac2efa76 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:41.115491 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f1ea6-4908-44b7-bad4-15c2ac2efa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:41.115898 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f1ea6-4908-44b7-bad4-15c2ac2efa76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:41.133575 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 307/617] 10.222.0.43 () {56 vars in 1135 bytes} [Wed May 25 13:51:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:41.139318 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cccf3-c596-4095-95d4-3dd679f9292d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:41.143648 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f1ea6-4908-44b7-bad4-15c2ac2efa76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5b9f1ea6-4908-44b7-bad4-15c2ac2efa76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:41.160920 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:41.163309 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:41.165402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:41.165402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:41.165402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:41.165402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:41.165402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:41.165402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:41.165402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:41.165402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:41.165402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:41.165402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:41.165402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:41.165402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:41.165402 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 311/618] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:41.169759 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f1ea6-4908-44b7-bad4-15c2ac2efa76 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:41.212073 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:41.279578 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:41.291157 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f1ea6-4908-44b7-bad4-15c2ac2efa76 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:41.317469 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cccf3-c596-4095-95d4-3dd679f9292d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:41.326989 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa52a8b-f81c-4946-9a3c-89520052960c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:41.327682 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa52a8b-f81c-4946-9a3c-89520052960c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:41.327997 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa52a8b-f81c-4946-9a3c-89520052960c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:41.328273 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa52a8b-f81c-4946-9a3c-89520052960c None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:41.329020 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa52a8b-f81c-4946-9a3c-89520052960c None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:41.329326 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa52a8b-f81c-4946-9a3c-89520052960c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:41.331358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa52a8b-f81c-4946-9a3c-89520052960c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:41.341638 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 312/619] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:41.347081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa52a8b-f81c-4946-9a3c-89520052960c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:41.419274 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ecf19-271a-4157-9f14-4d2ea1d8679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:41.420439 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ecf19-271a-4157-9f14-4d2ea1d8679c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:41.420925 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ecf19-271a-4157-9f14-4d2ea1d8679c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:41.421395 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ecf19-271a-4157-9f14-4d2ea1d8679c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:41.449863 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ecf19-271a-4157-9f14-4d2ea1d8679c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:41.451703 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ecf19-271a-4157-9f14-4d2ea1d8679c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:41.461120 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa52a8b-f81c-4946-9a3c-89520052960c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9d3ecf19-271a-4157-9f14-4d2ea1d8679c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:41.495774 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:41.496750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:41.497623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:41.497623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:41.497623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:41.497623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:41.499850 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253048b-8bd3-428f-afe5-b396d1ed5032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:41.501290 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253048b-8bd3-428f-afe5-b396d1ed5032 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:41.501290 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253048b-8bd3-428f-afe5-b396d1ed5032 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:41.501290 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253048b-8bd3-428f-afe5-b396d1ed5032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:41.501870 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 308/620] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:41.507487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ecf19-271a-4157-9f14-4d2ea1d8679c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:41.516415 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253048b-8bd3-428f-afe5-b396d1ed5032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:41.518863 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253048b-8bd3-428f-afe5-b396d1ed5032 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5253048b-8bd3-428f-afe5-b396d1ed5032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:41.550191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:41.551159 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:41.552052 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:41.552052 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:41.552052 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:41.552052 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:41.552052 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 313/621] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:41.552052 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253048b-8bd3-428f-afe5-b396d1ed5032 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:41.563501 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:41.693541 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253048b-8bd3-428f-afe5-b396d1ed5032 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:41.704279 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:41.710733 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ecf19-271a-4157-9f14-4d2ea1d8679c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:41.730375 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc164e3-a418-4db9-bb19-79077ceed41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:41.731354 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc164e3-a418-4db9-bb19-79077ceed41f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:41.731661 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc164e3-a418-4db9-bb19-79077ceed41f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:41.732136 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc164e3-a418-4db9-bb19-79077ceed41f None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:41.733047 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc164e3-a418-4db9-bb19-79077ceed41f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:41.733358 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc164e3-a418-4db9-bb19-79077ceed41f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:41.735919 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc164e3-a418-4db9-bb19-79077ceed41f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:41.755884 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 314/622] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:41.757289 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02a26-f18d-4569-94ee-849646b61f5e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:41.757579 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02a26-f18d-4569-94ee-849646b61f5e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:41.757856 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02a26-f18d-4569-94ee-849646b61f5e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:41.759256 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 315/623] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:41.763281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b02a26-f18d-4569-94ee-849646b61f5e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:41.767104 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc0904-33d2-4a12-bb25-0230e53f8f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:41.768122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc0904-33d2-4a12-bb25-0230e53f8f69 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:41.768612 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc0904-33d2-4a12-bb25-0230e53f8f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:41.769093 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc0904-33d2-4a12-bb25-0230e53f8f69 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:41.770016 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc0904-33d2-4a12-bb25-0230e53f8f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:41.770550 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc0904-33d2-4a12-bb25-0230e53f8f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:41.772174 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc0904-33d2-4a12-bb25-0230e53f8f69 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:41.784961 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 309/624] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:41.786499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260cf43-7741-409f-87cd-eae4bf49283c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:41.787105 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260cf43-7741-409f-87cd-eae4bf49283c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:41.787583 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260cf43-7741-409f-87cd-eae4bf49283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:41.805985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c260cf43-7741-409f-87cd-eae4bf49283c None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:41.807579 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c260cf43-7741-409f-87cd-eae4bf49283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:41.836843 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:41.896043 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 310/625] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:41.896043 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260cf43-7741-409f-87cd-eae4bf49283c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:41.899166 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b02a26-f18d-4569-94ee-849646b61f5e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:41.946204 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053681b-8eba-4e4f-bcfb-413a8cf82e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:41.947354 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053681b-8eba-4e4f-bcfb-413a8cf82e29 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:41.947891 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053681b-8eba-4e4f-bcfb-413a8cf82e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:41.948425 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053681b-8eba-4e4f-bcfb-413a8cf82e29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:41.959941 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053681b-8eba-4e4f-bcfb-413a8cf82e29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:41.961853 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053681b-8eba-4e4f-bcfb-413a8cf82e29 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7053681b-8eba-4e4f-bcfb-413a8cf82e29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:41.978758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:41.979796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:41.980737 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:41.980737 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:41.980737 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:41.980737 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:41.980737 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:41.980737 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:41.980737 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:41.980737 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:41.980737 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:51:41.980737 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:41.988150 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 316/626] 10.222.0.43 () {56 vars in 1093 bytes} [Wed May 25 13:51:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:41.989354 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053681b-8eba-4e4f-bcfb-413a8cf82e29 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:42.005492 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:42.023921 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260cf43-7741-409f-87cd-eae4bf49283c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:42.065890 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c3350-bbff-40cc-977a-267829d8b857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:42.067058 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3350-bbff-40cc-977a-267829d8b857 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:42.067567 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3350-bbff-40cc-977a-267829d8b857 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:42.068088 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3350-bbff-40cc-977a-267829d8b857 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:42.075826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c3350-bbff-40cc-977a-267829d8b857 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:42.077538 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c3350-bbff-40cc-977a-267829d8b857 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-580c3350-bbff-40cc-977a-267829d8b857 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:42.093826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:42.094765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:42.095647 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:42.095647 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:42.095647 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:42.095647 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:42.095647 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:42.095647 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:42.095647 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:42.095647 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:42.098258 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 311/627] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:42.099440 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c3350-bbff-40cc-977a-267829d8b857 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:42.106295 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053681b-8eba-4e4f-bcfb-413a8cf82e29 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:42.134873 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:42.148169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536bf76-edfd-4afa-9196-88a3809f22a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:42.149363 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536bf76-edfd-4afa-9196-88a3809f22a7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:42.149659 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536bf76-edfd-4afa-9196-88a3809f22a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:42.157152 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536bf76-edfd-4afa-9196-88a3809f22a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:42.163766 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536bf76-edfd-4afa-9196-88a3809f22a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b536bf76-edfd-4afa-9196-88a3809f22a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:42.174156 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:42.175594 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:42.176674 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:42.176674 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:42.176674 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:42.176674 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:42.176674 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:42.176674 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:42.176674 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:42.176674 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:42.176674 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:42.176674 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:42.176674 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:42.176674 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:42.183709 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 317/628] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:42.183709 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536bf76-edfd-4afa-9196-88a3809f22a7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:42.230775 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c3350-bbff-40cc-977a-267829d8b857 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:42.278104 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f7cbb-a100-46e5-8288-b473817b8e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:42.278925 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f7cbb-a100-46e5-8288-b473817b8e34 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:42.279294 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f7cbb-a100-46e5-8288-b473817b8e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:42.280025 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f7cbb-a100-46e5-8288-b473817b8e34 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:42.281251 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f7cbb-a100-46e5-8288-b473817b8e34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:42.281822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f7cbb-a100-46e5-8288-b473817b8e34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:42.284212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f7cbb-a100-46e5-8288-b473817b8e34 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:42.305280 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536bf76-edfd-4afa-9196-88a3809f22a7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:42.314187 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 312/629] 10.222.0.43 () {56 vars in 1133 bytes} [Wed May 25 13:51:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:42.314187 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f7cbb-a100-46e5-8288-b473817b8e34 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:42.314577 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:42.350034 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b0158-d82d-47a9-b6a8-ee2b6114b932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:42.351191 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b0158-d82d-47a9-b6a8-ee2b6114b932 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:42.351751 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b0158-d82d-47a9-b6a8-ee2b6114b932 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:42.352284 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b0158-d82d-47a9-b6a8-ee2b6114b932 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:42.353290 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b0158-d82d-47a9-b6a8-ee2b6114b932 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:42.353798 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b0158-d82d-47a9-b6a8-ee2b6114b932 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:42.355637 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b0158-d82d-47a9-b6a8-ee2b6114b932 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:42.371086 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 318/630] 10.222.0.43 () {56 vars in 1148 bytes} [Wed May 25 13:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:42.373707 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b0158-d82d-47a9-b6a8-ee2b6114b932 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:42.429483 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:42.456719 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f7cbb-a100-46e5-8288-b473817b8e34 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:42.498170 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a0f04-643c-4911-9503-2ef54412daa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:42.499328 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a0f04-643c-4911-9503-2ef54412daa6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:42.499994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a0f04-643c-4911-9503-2ef54412daa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:42.500487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a0f04-643c-4911-9503-2ef54412daa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:42.501443 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a0f04-643c-4911-9503-2ef54412daa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:42.501950 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a0f04-643c-4911-9503-2ef54412daa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:42.503401 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b0158-d82d-47a9-b6a8-ee2b6114b932 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:42.504471 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a0f04-643c-4911-9503-2ef54412daa6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:42.518759 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 313/631] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:42.520193 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a0f04-643c-4911-9503-2ef54412daa6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:42.545611 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ea51f-0f22-4fee-a0ad-06f61261d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:42.546718 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ea51f-0f22-4fee-a0ad-06f61261d082 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:42.547210 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ea51f-0f22-4fee-a0ad-06f61261d082 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:42.547689 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ea51f-0f22-4fee-a0ad-06f61261d082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:42.607319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:42.626152 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ea51f-0f22-4fee-a0ad-06f61261d082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:42.628551 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ea51f-0f22-4fee-a0ad-06f61261d082 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:42.651751 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a0f04-643c-4911-9503-2ef54412daa6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:42.677558 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:42.690320 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2f911-3011-4aae-a6c4-51c93a263c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:42.691345 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2f911-3011-4aae-a6c4-51c93a263c97 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:42.691891 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2f911-3011-4aae-a6c4-51c93a263c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:42.692079 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2f911-3011-4aae-a6c4-51c93a263c97 None admin] PATH_INFO: `/v3/projects/8686972299d942168ba6ed9c25bf6ec9/users/d2abda8aa7344dd5bc53365dc6b8d261/roles/97c702855bb64e118e62642a59a444b9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:42.708753 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2f911-3011-4aae-a6c4-51c93a263c97 None admin] RBAC: Authorizing `identity:create_grant(project_id=8686972299d942168ba6ed9c25bf6ec9, user_id=d2abda8aa7344dd5bc53365dc6b8d261, role_id=97c702855bb64e118e62642a59a444b9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:42.710212 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2f911-3011-4aae-a6c4-51c93a263c97 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:42.739433 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 319/632] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:42.740134 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ea51f-0f22-4fee-a0ad-06f61261d082 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:42.777259 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 314/633] 10.222.0.43 () {58 vars in 1439 bytes} [Wed May 25 13:51:42 2022] PUT /identity/v3/projects/8686972299d942168ba6ed9c25bf6ec9/users/d2abda8aa7344dd5bc53365dc6b8d261/roles/97c702855bb64e118e62642a59a444b9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:42.789461 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5488e-0aa0-46d2-b7aa-de76a7bfeb04 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:42.789843 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5488e-0aa0-46d2-b7aa-de76a7bfeb04 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:42.790032 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5488e-0aa0-46d2-b7aa-de76a7bfeb04 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:42.795800 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 315/634] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:42.795800 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5488e-0aa0-46d2-b7aa-de76a7bfeb04 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:42.871270 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ea51f-0f22-4fee-a0ad-06f61261d082 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:42.919104 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57b9e9-82f1-4126-b8b0-9188f015a229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:42.920762 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57b9e9-82f1-4126-b8b0-9188f015a229 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:42.921201 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57b9e9-82f1-4126-b8b0-9188f015a229 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:42.921788 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57b9e9-82f1-4126-b8b0-9188f015a229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:42.935165 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57b9e9-82f1-4126-b8b0-9188f015a229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:42.937110 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57b9e9-82f1-4126-b8b0-9188f015a229 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:42.941702 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:42.949759 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5488e-0aa0-46d2-b7aa-de76a7bfeb04 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-8b57b9e9-82f1-4126-b8b0-9188f015a229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:42.962139 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:42.963591 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:42.964806 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:42.964806 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:42.964806 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:42.964806 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:42.972479 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 320/635] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:42.973128 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:42.975521 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837da4ab-696a-4237-9e78-fdc3cb9be8b3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:42.976077 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837da4ab-696a-4237-9e78-fdc3cb9be8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:42.976541 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837da4ab-696a-4237-9e78-fdc3cb9be8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:42.998151 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-837da4ab-696a-4237-9e78-fdc3cb9be8b3 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:42.999415 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-837da4ab-696a-4237-9e78-fdc3cb9be8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:42.999981 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8867295-270d-499c-803f-169c7be549e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:43.000879 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867295-270d-499c-803f-169c7be549e7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:43.001164 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867295-270d-499c-803f-169c7be549e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:43.001439 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867295-270d-499c-803f-169c7be549e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:43.014157 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8867295-270d-499c-803f-169c7be549e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:43.022115 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8867295-270d-499c-803f-169c7be549e7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f8867295-270d-499c-803f-169c7be549e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:43.033884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:43.034926 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:43.035849 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:43.035849 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:43.035849 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:43.035849 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:43.035849 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 316/636] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:43.036156 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8867295-270d-499c-803f-169c7be549e7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:43.081959 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 321/637] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:43.081959 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abc5f3-6053-45c0-b078-9bcc3d1c1e43 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:43.081959 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abc5f3-6053-45c0-b078-9bcc3d1c1e43 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:43.081959 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abc5f3-6053-45c0-b078-9bcc3d1c1e43 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:43.081959 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 322/638] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:43.081959 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abc5f3-6053-45c0-b078-9bcc3d1c1e43 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:43.147589 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8867295-270d-499c-803f-169c7be549e7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:43.184037 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a54146-2bc9-499c-b9a2-fd9e90931909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:43.184700 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a54146-2bc9-499c-b9a2-fd9e90931909 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:43.184985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a54146-2bc9-499c-b9a2-fd9e90931909 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:43.185263 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a54146-2bc9-499c-b9a2-fd9e90931909 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:43.185978 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a54146-2bc9-499c-b9a2-fd9e90931909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:43.186284 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a54146-2bc9-499c-b9a2-fd9e90931909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:43.187411 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abc5f3-6053-45c0-b078-9bcc3d1c1e43 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:43.187673 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a54146-2bc9-499c-b9a2-fd9e90931909 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:43.203929 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 317/639] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:43.203929 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298e08-deed-435e-b082-52b4d898c480 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:43.203929 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298e08-deed-435e-b082-52b4d898c480 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:43.203929 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298e08-deed-435e-b082-52b4d898c480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:43.218693 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:43.220462 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6d298e08-deed-435e-b082-52b4d898c480 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:43.222333 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6d298e08-deed-435e-b082-52b4d898c480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:43.228440 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb2af-83ad-4738-8f99-2cc930691cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:43.230429 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb2af-83ad-4738-8f99-2cc930691cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:43.230429 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb2af-83ad-4738-8f99-2cc930691cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:43.230429 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb2af-83ad-4738-8f99-2cc930691cd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:43.230429 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcb2af-83ad-4738-8f99-2cc930691cd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:43.230704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcb2af-83ad-4738-8f99-2cc930691cd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:43.232238 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcb2af-83ad-4738-8f99-2cc930691cd3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:43.244070 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 323/640] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:43.245864 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:43.249458 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb2af-83ad-4738-8f99-2cc930691cd3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:43.307875 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 318/641] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:43.308877 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298e08-deed-435e-b082-52b4d898c480 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:43.364158 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb2af-83ad-4738-8f99-2cc930691cd3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:43.401097 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8b424-5078-4372-8f3d-016d88569940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:43.401889 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8b424-5078-4372-8f3d-016d88569940 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:43.402174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8b424-5078-4372-8f3d-016d88569940 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:43.402448 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8b424-5078-4372-8f3d-016d88569940 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:43.413413 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8b424-5078-4372-8f3d-016d88569940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-54c8b424-5078-4372-8f3d-016d88569940 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:43.421170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:43.422099 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:43.427981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:43.427981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:43.427981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:43.427981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:43.427981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:43.427981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:43.427981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:43.427981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:43.427981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:43.427981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:43.427981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:43.427981 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:43.428619 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298e08-deed-435e-b082-52b4d898c480 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:43.428705 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 324/642] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:43.428705 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8b424-5078-4372-8f3d-016d88569940 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:43.463986 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c4b8-f8cc-44c6-8cc4-8b98688201d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:43.464864 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c4b8-f8cc-44c6-8cc4-8b98688201d3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:43.465211 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c4b8-f8cc-44c6-8cc4-8b98688201d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:43.465549 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c4b8-f8cc-44c6-8cc4-8b98688201d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:43.473611 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712c4b8-f8cc-44c6-8cc4-8b98688201d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:43.476397 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712c4b8-f8cc-44c6-8cc4-8b98688201d3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:43.476497 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f712c4b8-f8cc-44c6-8cc4-8b98688201d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:43.490155 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:43.491197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:43.492561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:43.492561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:43.492561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:43.492561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:43.492561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:43.492561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:43.492561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:43.492561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:43.492561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:51:43.492561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:43.492561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 319/643] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:43.492561 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c4b8-f8cc-44c6-8cc4-8b98688201d3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:43.513377 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:43.538723 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8b424-5078-4372-8f3d-016d88569940 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:43.578782 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23602d6e-a0c2-4d25-bc10-43556614921f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:43.579629 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23602d6e-a0c2-4d25-bc10-43556614921f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:43.579935 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23602d6e-a0c2-4d25-bc10-43556614921f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:43.580477 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23602d6e-a0c2-4d25-bc10-43556614921f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:43.587895 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23602d6e-a0c2-4d25-bc10-43556614921f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:43.589617 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23602d6e-a0c2-4d25-bc10-43556614921f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:43.602745 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c4b8-f8cc-44c6-8cc4-8b98688201d3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-23602d6e-a0c2-4d25-bc10-43556614921f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:43.605628 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:43.606686 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:43.607993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:43.607993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:43.607993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:43.607993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:43.607993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:43.607993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:43.607993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:43.607993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:43.607993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 325/644] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:43.607993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23602d6e-a0c2-4d25-bc10-43556614921f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:43.644493 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532e9e6-28a3-400d-acce-a9cb37b4b682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:43.645540 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532e9e6-28a3-400d-acce-a9cb37b4b682 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:43.645981 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532e9e6-28a3-400d-acce-a9cb37b4b682 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:43.646418 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532e9e6-28a3-400d-acce-a9cb37b4b682 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:43.657711 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532e9e6-28a3-400d-acce-a9cb37b4b682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1532e9e6-28a3-400d-acce-a9cb37b4b682 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:43.666558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:43.667487 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:43.672693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:43.672693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:43.672693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:43.672693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:43.672693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:43.672693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:43.672693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:43.672693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:43.672693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:43.672693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:43.672693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:43.672693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:43.672693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 320/645] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:43.672693 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532e9e6-28a3-400d-acce-a9cb37b4b682 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:43.724379 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23602d6e-a0c2-4d25-bc10-43556614921f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:43.732308 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:43.757737 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:43.761154 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d545857-ae04-45d8-bbac-6df92f54c760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:43.761888 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d545857-ae04-45d8-bbac-6df92f54c760 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:43.762238 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d545857-ae04-45d8-bbac-6df92f54c760 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:43.762589 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d545857-ae04-45d8-bbac-6df92f54c760 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:43.763665 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d545857-ae04-45d8-bbac-6df92f54c760 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:43.764211 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d545857-ae04-45d8-bbac-6df92f54c760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:43.765800 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d545857-ae04-45d8-bbac-6df92f54c760 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:43.775071 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 326/646] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:43.779549 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d545857-ae04-45d8-bbac-6df92f54c760 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:43.784922 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532e9e6-28a3-400d-acce-a9cb37b4b682 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:43.821646 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ef1e2-db98-4893-be0f-b81c86d7365b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:43.822408 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ef1e2-db98-4893-be0f-b81c86d7365b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:43.822755 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ef1e2-db98-4893-be0f-b81c86d7365b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:43.823197 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ef1e2-db98-4893-be0f-b81c86d7365b None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:43.824137 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ef1e2-db98-4893-be0f-b81c86d7365b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:43.824519 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ef1e2-db98-4893-be0f-b81c86d7365b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:43.826124 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ef1e2-db98-4893-be0f-b81c86d7365b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:43.850399 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 321/647] 10.222.0.43 () {56 vars in 1137 bytes} [Wed May 25 13:51:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:43.850399 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ef1e2-db98-4893-be0f-b81c86d7365b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:43.886421 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d545857-ae04-45d8-bbac-6df92f54c760 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:43.920816 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435e4cb-bc28-4ac5-82fd-06e2b928c05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:43.921629 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435e4cb-bc28-4ac5-82fd-06e2b928c05d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:43.922014 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435e4cb-bc28-4ac5-82fd-06e2b928c05d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:43.922392 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435e4cb-bc28-4ac5-82fd-06e2b928c05d None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:43.923291 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435e4cb-bc28-4ac5-82fd-06e2b928c05d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:43.923704 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435e4cb-bc28-4ac5-82fd-06e2b928c05d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:43.925795 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435e4cb-bc28-4ac5-82fd-06e2b928c05d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:43.938717 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 327/648] 10.222.0.43 () {56 vars in 1148 bytes} [Wed May 25 13:51:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:43.941120 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435e4cb-bc28-4ac5-82fd-06e2b928c05d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:43.954435 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ef1e2-db98-4893-be0f-b81c86d7365b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:43.974964 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:43.998694 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e172d-0694-43e4-981b-14955a420865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:43.999353 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e172d-0694-43e4-981b-14955a420865 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:44.008692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e172d-0694-43e4-981b-14955a420865 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:44.008692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e172d-0694-43e4-981b-14955a420865 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:44.008692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e172d-0694-43e4-981b-14955a420865 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:44.008692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e172d-0694-43e4-981b-14955a420865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:44.008692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e172d-0694-43e4-981b-14955a420865 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:44.008692 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:44.019874 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 322/649] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:44.020819 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e172d-0694-43e4-981b-14955a420865 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:44.055169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435e4cb-bc28-4ac5-82fd-06e2b928c05d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:44.091801 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0b3d8-4a8d-4479-a85c-b73a55d0c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:44.092569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0b3d8-4a8d-4479-a85c-b73a55d0c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:44.092859 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0b3d8-4a8d-4479-a85c-b73a55d0c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:44.093133 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0b3d8-4a8d-4479-a85c-b73a55d0c0c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:44.103805 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0b3d8-4a8d-4479-a85c-b73a55d0c0c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:44.105208 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0b3d8-4a8d-4479-a85c-b73a55d0c0c6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-bee0b3d8-4a8d-4479-a85c-b73a55d0c0c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:44.123442 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:44.124569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:44.125455 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:44.125455 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:44.125455 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:44.125455 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:44.125455 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 328/650] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:44.125455 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0b3d8-4a8d-4479-a85c-b73a55d0c0c6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:44.131933 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e172d-0694-43e4-981b-14955a420865 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:44.165542 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f78bf-7bf5-4405-8637-17cf6e1e50c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:44.166187 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f78bf-7bf5-4405-8637-17cf6e1e50c6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:44.166472 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f78bf-7bf5-4405-8637-17cf6e1e50c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:44.166750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f78bf-7bf5-4405-8637-17cf6e1e50c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:44.211352 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:44.229994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0b3d8-4a8d-4479-a85c-b73a55d0c0c6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:44.238822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:44.243672 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f78bf-7bf5-4405-8637-17cf6e1e50c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:44.245217 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f78bf-7bf5-4405-8637-17cf6e1e50c6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:44.266441 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe3597-6f6c-47c7-bbb4-0293d7d4e6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:44.267093 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3597-6f6c-47c7-bbb4-0293d7d4e6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:44.267747 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3597-6f6c-47c7-bbb4-0293d7d4e6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:44.268461 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3597-6f6c-47c7-bbb4-0293d7d4e6e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:44.269323 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe3597-6f6c-47c7-bbb4-0293d7d4e6e0 None admin] RBAC: Adding query filter params (role.id=97c702855bb64e118e62642a59a444b9, scope.project.id=8686972299d942168ba6ed9c25bf6ec9, user.id=c1dc40f3b4a942f9b52ec74452309aac) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:44.269644 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe3597-6f6c-47c7-bbb4-0293d7d4e6e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:44.271076 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe3597-6f6c-47c7-bbb4-0293d7d4e6e0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:44.277213 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 329/651] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:51:44 2022] GET /identity/v3/role_assignments?user.id=c1dc40f3b4a942f9b52ec74452309aac&scope.project.id=8686972299d942168ba6ed9c25bf6ec9&role.id=97c702855bb64e118e62642a59a444b9 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:44.277986 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe3597-6f6c-47c7-bbb4-0293d7d4e6e0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:44.397417 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 323/652] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:44.400071 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f78bf-7bf5-4405-8637-17cf6e1e50c6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:44.406549 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe3597-6f6c-47c7-bbb4-0293d7d4e6e0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:44.448744 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98fd7b-2727-4e0c-bfed-60239be81967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:44.449558 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98fd7b-2727-4e0c-bfed-60239be81967 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:44.449818 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98fd7b-2727-4e0c-bfed-60239be81967 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:44.450093 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98fd7b-2727-4e0c-bfed-60239be81967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:44.463512 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98fd7b-2727-4e0c-bfed-60239be81967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:44.465056 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98fd7b-2727-4e0c-bfed-60239be81967 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:44.468340 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-cb98fd7b-2727-4e0c-bfed-60239be81967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:44.485072 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:44.486237 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:44.488270 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:44.488270 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:44.488270 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:44.488270 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:44.491638 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 330/653] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:44.492559 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98fd7b-2727-4e0c-bfed-60239be81967 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:44.550545 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:44.554478 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f78bf-7bf5-4405-8637-17cf6e1e50c6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:44.604569 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552b9c9-88f3-45c8-9bfa-ea8fe368697f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:44.605739 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552b9c9-88f3-45c8-9bfa-ea8fe368697f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:44.606037 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552b9c9-88f3-45c8-9bfa-ea8fe368697f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:44.606322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552b9c9-88f3-45c8-9bfa-ea8fe368697f None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:44.607350 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552b9c9-88f3-45c8-9bfa-ea8fe368697f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:44.607669 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552b9c9-88f3-45c8-9bfa-ea8fe368697f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:44.609870 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552b9c9-88f3-45c8-9bfa-ea8fe368697f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:44.618598 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98fd7b-2727-4e0c-bfed-60239be81967 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:44.633570 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 324/654] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:44.634492 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552b9c9-88f3-45c8-9bfa-ea8fe368697f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:44.657037 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ddf59-6096-4f7a-99db-162784c305fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:44.658194 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ddf59-6096-4f7a-99db-162784c305fe None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:44.659125 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ddf59-6096-4f7a-99db-162784c305fe None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:44.659584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ddf59-6096-4f7a-99db-162784c305fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:44.674817 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ddf59-6096-4f7a-99db-162784c305fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:44.676606 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ddf59-6096-4f7a-99db-162784c305fe None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-0a3ddf59-6096-4f7a-99db-162784c305fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:44.699174 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:44.700146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:44.701046 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:44.701046 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:44.701046 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:44.701046 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:44.701787 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 331/655] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:44.703334 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ddf59-6096-4f7a-99db-162784c305fe None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:44.750334 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552b9c9-88f3-45c8-9bfa-ea8fe368697f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:44.768805 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:44.788994 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a21b7f-da29-41d3-8a21-ad3e8aadc087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:44.789663 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a21b7f-da29-41d3-8a21-ad3e8aadc087 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:44.789948 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a21b7f-da29-41d3-8a21-ad3e8aadc087 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:44.790225 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a21b7f-da29-41d3-8a21-ad3e8aadc087 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:44.790949 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a21b7f-da29-41d3-8a21-ad3e8aadc087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:44.791251 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a21b7f-da29-41d3-8a21-ad3e8aadc087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:44.792796 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a21b7f-da29-41d3-8a21-ad3e8aadc087 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:44.810661 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 325/656] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:44.811938 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a21b7f-da29-41d3-8a21-ad3e8aadc087 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:44.834193 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:44.838048 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ddf59-6096-4f7a-99db-162784c305fe None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:44.885693 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5af27-1ff4-4dad-8833-ae895d9e756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:44.887107 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5af27-1ff4-4dad-8833-ae895d9e756a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:44.888374 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5af27-1ff4-4dad-8833-ae895d9e756a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:44.889454 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5af27-1ff4-4dad-8833-ae895d9e756a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:44.900806 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5af27-1ff4-4dad-8833-ae895d9e756a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:44.903317 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5af27-1ff4-4dad-8833-ae895d9e756a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e2f5af27-1ff4-4dad-8833-ae895d9e756a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:44.925376 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:44.926786 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:44.927758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:44.927758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:44.927758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:44.927758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:44.927758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:44.927758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:44.927758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:44.927758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:44.927758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 13:51:44.927758 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:44.934338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 332/657] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:44.934338 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5af27-1ff4-4dad-8833-ae895d9e756a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:44.939451 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a21b7f-da29-41d3-8a21-ad3e8aadc087 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:44.990087 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a05f03-cedf-4eb0-98b6-fef446e85801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:44.991661 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05f03-cedf-4eb0-98b6-fef446e85801 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:44.992191 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05f03-cedf-4eb0-98b6-fef446e85801 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:44.992936 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05f03-cedf-4eb0-98b6-fef446e85801 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:44.994110 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a05f03-cedf-4eb0-98b6-fef446e85801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:44.995012 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a05f03-cedf-4eb0-98b6-fef446e85801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:44.997175 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a05f03-cedf-4eb0-98b6-fef446e85801 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:45.015066 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 326/658] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:45.016309 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a05f03-cedf-4eb0-98b6-fef446e85801 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:45.045454 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5af27-1ff4-4dad-8833-ae895d9e756a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:45.055815 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:45.084366 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d9a53-4a66-4cc0-acc5-7710815aeb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:45.085096 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d9a53-4a66-4cc0-acc5-7710815aeb1b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:45.085375 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d9a53-4a66-4cc0-acc5-7710815aeb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:45.085649 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d9a53-4a66-4cc0-acc5-7710815aeb1b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:45.097151 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d9a53-4a66-4cc0-acc5-7710815aeb1b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:45.098842 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d9a53-4a66-4cc0-acc5-7710815aeb1b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d47d9a53-4a66-4cc0-acc5-7710815aeb1b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:45.116584 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:45.117575 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:45.123537 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:45.123537 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:45.123537 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:45.123537 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:45.123537 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:45.123537 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:45.123537 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:45.123537 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:45.123537 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:51:45.123537 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:45.123537 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 333/659] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:45.123537 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d9a53-4a66-4cc0-acc5-7710815aeb1b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:45.127687 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:45.150720 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a05f03-cedf-4eb0-98b6-fef446e85801 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:45.189565 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee9500-181e-4ac1-964a-44ab7de4a497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:45.190661 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee9500-181e-4ac1-964a-44ab7de4a497 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:45.190956 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee9500-181e-4ac1-964a-44ab7de4a497 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:45.191240 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee9500-181e-4ac1-964a-44ab7de4a497 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:45.192128 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee9500-181e-4ac1-964a-44ab7de4a497 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:45.192450 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee9500-181e-4ac1-964a-44ab7de4a497 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:45.193894 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee9500-181e-4ac1-964a-44ab7de4a497 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:45.212789 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 327/660] 10.222.0.43 () {56 vars in 1137 bytes} [Wed May 25 13:51:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:45.217285 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad7b6b-1f20-4da5-a0da-de2321be96da None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:45.217410 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad7b6b-1f20-4da5-a0da-de2321be96da None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:45.217670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad7b6b-1f20-4da5-a0da-de2321be96da None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:45.218930 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 328/661] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:45.219624 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad7b6b-1f20-4da5-a0da-de2321be96da None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:45.229520 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d9a53-4a66-4cc0-acc5-7710815aeb1b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:45.267221 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6e9c2-a33c-4c9c-a545-eaec5d75d51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:45.268067 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6e9c2-a33c-4c9c-a545-eaec5d75d51a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:45.268439 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6e9c2-a33c-4c9c-a545-eaec5d75d51a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:45.269005 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6e9c2-a33c-4c9c-a545-eaec5d75d51a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:45.275441 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6e9c2-a33c-4c9c-a545-eaec5d75d51a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:45.276935 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6e9c2-a33c-4c9c-a545-eaec5d75d51a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-70b6e9c2-a33c-4c9c-a545-eaec5d75d51a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:45.298098 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:45.299733 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:45.300864 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:45.300864 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:45.300864 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:45.300864 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:45.300864 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:45.300864 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:45.300864 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:45.300864 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:45.300864 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 334/662] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:45.301764 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6e9c2-a33c-4c9c-a545-eaec5d75d51a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:45.335016 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:45.342830 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad7b6b-1f20-4da5-a0da-de2321be96da None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:45.394966 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afa20a-f24a-4299-8481-23aa2b6bb21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:45.395775 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afa20a-f24a-4299-8481-23aa2b6bb21e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:45.400006 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afa20a-f24a-4299-8481-23aa2b6bb21e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:45.400306 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afa20a-f24a-4299-8481-23aa2b6bb21e None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:45.401153 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afa20a-f24a-4299-8481-23aa2b6bb21e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:45.401468 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afa20a-f24a-4299-8481-23aa2b6bb21e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:45.402910 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afa20a-f24a-4299-8481-23aa2b6bb21e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:45.405750 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:45.418669 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6e9c2-a33c-4c9c-a545-eaec5d75d51a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:45.426286 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 329/663] 10.222.0.43 () {56 vars in 1139 bytes} [Wed May 25 13:51:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:45.426286 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3bfa-623d-4a7a-8f66-c88e4a474a02 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:45.426286 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3bfa-623d-4a7a-8f66-c88e4a474a02 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:45.426286 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3bfa-623d-4a7a-8f66-c88e4a474a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:45.444183 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-36ff3bfa-623d-4a7a-8f66-c88e4a474a02 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:45.445421 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-36ff3bfa-623d-4a7a-8f66-c88e4a474a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:45.456799 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bff3b-bbd6-4734-9a02-079c9d8c0ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:45.457526 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bff3b-bbd6-4734-9a02-079c9d8c0ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:45.457870 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bff3b-bbd6-4734-9a02-079c9d8c0ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:45.458323 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bff3b-bbd6-4734-9a02-079c9d8c0ec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:45.523765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 330/664] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:45.523765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff3bfa-623d-4a7a-8f66-c88e4a474a02 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:45.542469 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bff3b-bbd6-4734-9a02-079c9d8c0ec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:45.545016 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bff3b-bbd6-4734-9a02-079c9d8c0ec6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:45.574192 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:45.646960 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff3bfa-623d-4a7a-8f66-c88e4a474a02 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:45.662169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 335/665] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:45.662169 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bff3b-bbd6-4734-9a02-079c9d8c0ec6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:45.677826 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:45.688697 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0e638-b3a1-49f7-a2f3-d29f2d6a0467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:45.689522 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0e638-b3a1-49f7-a2f3-d29f2d6a0467 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:45.689884 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0e638-b3a1-49f7-a2f3-d29f2d6a0467 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:45.690167 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0e638-b3a1-49f7-a2f3-d29f2d6a0467 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:45.690958 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0e638-b3a1-49f7-a2f3-d29f2d6a0467 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:45.692380 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0e638-b3a1-49f7-a2f3-d29f2d6a0467 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:45.692965 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0e638-b3a1-49f7-a2f3-d29f2d6a0467 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:45.707922 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 331/666] 10.222.0.43 () {56 vars in 1148 bytes} [Wed May 25 13:51:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:45.707922 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0e638-b3a1-49f7-a2f3-d29f2d6a0467 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:45.777204 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bff3b-bbd6-4734-9a02-079c9d8c0ec6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:45.804495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:45.811816 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0e638-b3a1-49f7-a2f3-d29f2d6a0467 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:45.813433 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3908a-b20c-4d2f-a26b-23ad39976dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:45.818324 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3908a-b20c-4d2f-a26b-23ad39976dbe None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:45.818324 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3908a-b20c-4d2f-a26b-23ad39976dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:45.818324 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3908a-b20c-4d2f-a26b-23ad39976dbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:45.848775 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322307b-9537-4663-bda5-f29f35e485f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:45.849578 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322307b-9537-4663-bda5-f29f35e485f6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:45.849862 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322307b-9537-4663-bda5-f29f35e485f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:45.850140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322307b-9537-4663-bda5-f29f35e485f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:45.860822 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322307b-9537-4663-bda5-f29f35e485f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b322307b-9537-4663-bda5-f29f35e485f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:45.868973 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:45.869895 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:45.870726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:45.870726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:45.870726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:45.870726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:45.870726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:45.870726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:45.870726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:45.870726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:45.870726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:45.870726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:45.870726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:51:45.870726 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:45.874971 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 332/667] 10.222.0.43 () {56 vars in 1102 bytes} [Wed May 25 13:51:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:45.875815 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322307b-9537-4663-bda5-f29f35e485f6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:45.891761 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3908a-b20c-4d2f-a26b-23ad39976dbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:45.893345 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3908a-b20c-4d2f-a26b-23ad39976dbe None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:45.928240 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:45.994371 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322307b-9537-4663-bda5-f29f35e485f6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:46.002636 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 336/668] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:46.004170 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3908a-b20c-4d2f-a26b-23ad39976dbe None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:46.032424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:46.035558 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5553a7-6389-48bb-b75d-1a14540235c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:46.036564 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5553a7-6389-48bb-b75d-1a14540235c0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:46.036996 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5553a7-6389-48bb-b75d-1a14540235c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:46.037418 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5553a7-6389-48bb-b75d-1a14540235c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:46.050502 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5553a7-6389-48bb-b75d-1a14540235c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:46.052200 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5553a7-6389-48bb-b75d-1a14540235c0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-de5553a7-6389-48bb-b75d-1a14540235c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:46.071906 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:46.072832 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:46.073703 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:46.073703 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:46.073703 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:46.073703 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:46.073703 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 333/669] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:46.073985 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5553a7-6389-48bb-b75d-1a14540235c0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:46.112389 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3908a-b20c-4d2f-a26b-23ad39976dbe None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:46.148401 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ed421-2333-452d-9b49-6cd0693de91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:46.149056 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ed421-2333-452d-9b49-6cd0693de91d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:46.149342 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ed421-2333-452d-9b49-6cd0693de91d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:46.149608 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ed421-2333-452d-9b49-6cd0693de91d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:46.150438 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ed421-2333-452d-9b49-6cd0693de91d None admin] RBAC: Adding query filter params (role.id=97c702855bb64e118e62642a59a444b9, scope.project.id=8686972299d942168ba6ed9c25bf6ec9, user.id=1cb9736c4af44cc0aa1f32878081baff) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:46.150750 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ed421-2333-452d-9b49-6cd0693de91d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:46.152219 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ed421-2333-452d-9b49-6cd0693de91d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:46.158281 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 337/670] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:51:46 2022] GET /identity/v3/role_assignments?user.id=1cb9736c4af44cc0aa1f32878081baff&scope.project.id=8686972299d942168ba6ed9c25bf6ec9&role.id=97c702855bb64e118e62642a59a444b9 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:46.159275 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ed421-2333-452d-9b49-6cd0693de91d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:46.209322 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:46.217215 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5553a7-6389-48bb-b75d-1a14540235c0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:46.258218 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6f2d-f05c-4876-b948-66817f2b59c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:46.259582 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6f2d-f05c-4876-b948-66817f2b59c8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:46.260388 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6f2d-f05c-4876-b948-66817f2b59c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:46.260852 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6f2d-f05c-4876-b948-66817f2b59c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:46.262140 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a6f2d-f05c-4876-b948-66817f2b59c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:46.262641 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a6f2d-f05c-4876-b948-66817f2b59c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:46.264984 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a6f2d-f05c-4876-b948-66817f2b59c8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:46.276173 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:46.281405 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 334/671] 10.222.0.43 () {56 vars in 1103 bytes} [Wed May 25 13:51:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:46.282234 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6f2d-f05c-4876-b948-66817f2b59c8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:46.304549 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ed421-2333-452d-9b49-6cd0693de91d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:46.352492 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f656d-b022-4763-910c-3a22d97809f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:46.353682 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f656d-b022-4763-910c-3a22d97809f4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:46.354171 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f656d-b022-4763-910c-3a22d97809f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:46.354650 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f656d-b022-4763-910c-3a22d97809f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:46.370541 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f656d-b022-4763-910c-3a22d97809f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:46.372562 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f656d-b022-4763-910c-3a22d97809f4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9f6f656d-b022-4763-910c-3a22d97809f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:46.395061 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:46.396242 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:46.397175 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:46.397175 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:46.397175 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:46.397175 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:46.397175 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 338/672] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:46.397175 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f656d-b022-4763-910c-3a22d97809f4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:46.423420 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6f2d-f05c-4876-b948-66817f2b59c8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:46.469308 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d7279-fcb9-43e0-9c3a-27d77d557c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:46.470120 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d7279-fcb9-43e0-9c3a-27d77d557c46 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:46.470477 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d7279-fcb9-43e0-9c3a-27d77d557c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:46.471499 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d7279-fcb9-43e0-9c3a-27d77d557c46 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:46.472722 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d7279-fcb9-43e0-9c3a-27d77d557c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:46.473039 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d7279-fcb9-43e0-9c3a-27d77d557c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:46.475423 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d7279-fcb9-43e0-9c3a-27d77d557c46 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:46.493891 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 335/673] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:46.494965 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d7279-fcb9-43e0-9c3a-27d77d557c46 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:46.520360 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:46.533641 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f656d-b022-4763-910c-3a22d97809f4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:46.586150 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cbd3a-7da5-4eed-9ab4-fa77959a036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:46.587813 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cbd3a-7da5-4eed-9ab4-fa77959a036f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:46.588526 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cbd3a-7da5-4eed-9ab4-fa77959a036f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:46.588951 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cbd3a-7da5-4eed-9ab4-fa77959a036f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:46.604201 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cbd3a-7da5-4eed-9ab4-fa77959a036f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:46.606783 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cbd3a-7da5-4eed-9ab4-fa77959a036f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:46.610545 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:46.614585 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d7279-fcb9-43e0-9c3a-27d77d557c46 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-148cbd3a-7da5-4eed-9ab4-fa77959a036f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:46.631976 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:46.633126 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:46.634255 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:46.634255 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:46.634255 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:46.634255 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:46.636864 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 339/674] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:46.637902 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cbd3a-7da5-4eed-9ab4-fa77959a036f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:46.662380 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea95676-0101-443a-947e-85a8a96eaa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:46.663321 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea95676-0101-443a-947e-85a8a96eaa58 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:46.663780 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea95676-0101-443a-947e-85a8a96eaa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:46.664200 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea95676-0101-443a-947e-85a8a96eaa58 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:46.665635 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea95676-0101-443a-947e-85a8a96eaa58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:46.666261 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea95676-0101-443a-947e-85a8a96eaa58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:46.668189 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea95676-0101-443a-947e-85a8a96eaa58 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:46.681191 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 336/675] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:46.682334 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea95676-0101-443a-947e-85a8a96eaa58 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:46.751672 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cbd3a-7da5-4eed-9ab4-fa77959a036f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:46.770648 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:46.786893 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b20046-b531-48b2-82ed-094e92a69af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:46.787689 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b20046-b531-48b2-82ed-094e92a69af3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:46.787993 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b20046-b531-48b2-82ed-094e92a69af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:46.788266 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b20046-b531-48b2-82ed-094e92a69af3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:46.792321 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea95676-0101-443a-947e-85a8a96eaa58 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:46.795053 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b20046-b531-48b2-82ed-094e92a69af3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:46.796522 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b20046-b531-48b2-82ed-094e92a69af3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e5b20046-b531-48b2-82ed-094e92a69af3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:46.812923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:46.813883 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:46.814825 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:46.814825 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:46.814825 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:46.814825 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:46.814825 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:46.814825 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:46.814825 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:46.814825 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:46.814825 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 340/676] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:46.815884 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b30f00-d414-4ab2-829d-c2c698201b44 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:46.815884 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b30f00-d414-4ab2-829d-c2c698201b44 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:46.816056 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b30f00-d414-4ab2-829d-c2c698201b44 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:46.819644 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 341/677] 10.222.0.43 () {54 vars in 926 bytes} [Wed May 25 13:51:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:46.820671 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b30f00-d414-4ab2-829d-c2c698201b44 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:46.834461 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6173f-9b3d-44fe-a8af-5658cb1b709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:46.835211 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6173f-9b3d-44fe-a8af-5658cb1b709c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:46.835502 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6173f-9b3d-44fe-a8af-5658cb1b709c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:46.835808 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6173f-9b3d-44fe-a8af-5658cb1b709c None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:46.836542 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6173f-9b3d-44fe-a8af-5658cb1b709c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:46.836853 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6173f-9b3d-44fe-a8af-5658cb1b709c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:46.838623 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6173f-9b3d-44fe-a8af-5658cb1b709c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:46.851134 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 337/678] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:46.851980 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6173f-9b3d-44fe-a8af-5658cb1b709c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:46.886923 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:46.937691 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b30f00-d414-4ab2-829d-c2c698201b44 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:46.962620 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6173f-9b3d-44fe-a8af-5658cb1b709c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:46.974766 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca8653-6638-463a-8626-0f7fdf95b6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:46.975569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca8653-6638-463a-8626-0f7fdf95b6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:46.975893 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca8653-6638-463a-8626-0f7fdf95b6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:46.976175 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca8653-6638-463a-8626-0f7fdf95b6a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:46.983135 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca8653-6638-463a-8626-0f7fdf95b6a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:46.984643 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca8653-6638-463a-8626-0f7fdf95b6a2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-64ca8653-6638-463a-8626-0f7fdf95b6a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:47.001087 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:47.002781 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:47.008986 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:47.008986 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:47.008986 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:47.008986 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:47.008986 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:47.008986 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:47.008986 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:47.008986 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:47.009426 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f50cfd-d52c-492d-a213-bdb570fe73a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:47.009426 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f50cfd-d52c-492d-a213-bdb570fe73a3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:47.009426 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f50cfd-d52c-492d-a213-bdb570fe73a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:47.009426 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f50cfd-d52c-492d-a213-bdb570fe73a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:47.009690 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 342/679] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:47.009765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f50cfd-d52c-492d-a213-bdb570fe73a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:47.009765 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f50cfd-d52c-492d-a213-bdb570fe73a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:47.009887 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692d52-ffd9-4169-972b-8a53536651e4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:47.009887 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692d52-ffd9-4169-972b-8a53536651e4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:47.009887 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692d52-ffd9-4169-972b-8a53536651e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:47.010068 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f50cfd-d52c-492d-a213-bdb570fe73a3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:47.016758 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:47.027922 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 338/680] 10.222.0.43 () {56 vars in 1148 bytes} [Wed May 25 13:51:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:47.027922 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f50cfd-d52c-492d-a213-bdb570fe73a3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:47.028146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-19692d52-ffd9-4169-972b-8a53536651e4 None None] MFA Rules not processed for user `10eec1f5d0fc4da09d1b4c7f6fd362eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:47.028146 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-19692d52-ffd9-4169-972b-8a53536651e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:47.100493 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 343/681] 10.222.0.43 () {58 vars in 1023 bytes} [Wed May 25 13:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:51:47.101613 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19692d52-ffd9-4169-972b-8a53536651e4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:47.141334 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f50cfd-d52c-492d-a213-bdb570fe73a3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:47.166025 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:47.178924 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba88b5-2193-4a6a-8392-08a6bdebdd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:47.179747 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba88b5-2193-4a6a-8392-08a6bdebdd4a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:47.180107 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba88b5-2193-4a6a-8392-08a6bdebdd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:47.180319 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba88b5-2193-4a6a-8392-08a6bdebdd4a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:47.188177 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba88b5-2193-4a6a-8392-08a6bdebdd4a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:47.190745 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba88b5-2193-4a6a-8392-08a6bdebdd4a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6aba88b5-2193-4a6a-8392-08a6bdebdd4a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:47.205643 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:47.206608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:47.207621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:47.207621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:47.207621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:47.207621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:47.207621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:47.207621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:47.207621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:47.207621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:47.207621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:51:47.207621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:47.207621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 339/682] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:51:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:47.207621 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba88b5-2193-4a6a-8392-08a6bdebdd4a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:47.227356 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19692d52-ffd9-4169-972b-8a53536651e4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:47.262994 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3b6e2-aad3-4960-856f-1656978f1803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:47.263650 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3b6e2-aad3-4960-856f-1656978f1803 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:47.263958 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3b6e2-aad3-4960-856f-1656978f1803 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:47.264236 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3b6e2-aad3-4960-856f-1656978f1803 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:47.265020 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3b6e2-aad3-4960-856f-1656978f1803 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:47.265337 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3b6e2-aad3-4960-856f-1656978f1803 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:47.266796 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3b6e2-aad3-4960-856f-1656978f1803 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:47.271988 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:47.284536 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 344/683] 10.222.0.43 () {56 vars in 1148 bytes} [Wed May 25 13:51:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:47.284536 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3b6e2-aad3-4960-856f-1656978f1803 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:47.322336 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba88b5-2193-4a6a-8392-08a6bdebdd4a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:47.358093 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc686489-09aa-4939-88a6-61300c4f3bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:47.358751 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc686489-09aa-4939-88a6-61300c4f3bef None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:47.359034 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc686489-09aa-4939-88a6-61300c4f3bef None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:47.359308 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc686489-09aa-4939-88a6-61300c4f3bef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:47.360183 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc686489-09aa-4939-88a6-61300c4f3bef None admin] RBAC: Adding query filter params (role.id=97c702855bb64e118e62642a59a444b9, scope.project.id=8686972299d942168ba6ed9c25bf6ec9, user.id=67f88f575ce742d584db7fa53d986143) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:47.360498 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc686489-09aa-4939-88a6-61300c4f3bef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:47.362771 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc686489-09aa-4939-88a6-61300c4f3bef None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:47.370535 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 340/684] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:51:47 2022] GET /identity/v3/role_assignments?user.id=67f88f575ce742d584db7fa53d986143&scope.project.id=8686972299d942168ba6ed9c25bf6ec9&role.id=97c702855bb64e118e62642a59a444b9 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:47.371430 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc686489-09aa-4939-88a6-61300c4f3bef None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:47.430194 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3b6e2-aad3-4960-856f-1656978f1803 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:47.441488 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:47.482491 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708646f0-9776-4688-96d2-0b27f9434279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:47.483619 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708646f0-9776-4688-96d2-0b27f9434279 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:47.484374 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708646f0-9776-4688-96d2-0b27f9434279 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:47.484866 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708646f0-9776-4688-96d2-0b27f9434279 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:47.502118 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708646f0-9776-4688-96d2-0b27f9434279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:51:47.505089 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc686489-09aa-4939-88a6-61300c4f3bef None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-708646f0-9776-4688-96d2-0b27f9434279 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:51:47.512381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:47.513424 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:47.514247 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:47.514247 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:47.514247 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:47.514247 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:47.514247 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:51:47.514247 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:51:47.514247 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:51:47.514247 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:51:47.514247 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:51:47.514247 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:51:47.514247 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:51:47.514247 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:47.522676 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 345/685] 10.222.0.43 () {56 vars in 1096 bytes} [Wed May 25 13:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:47.522676 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708646f0-9776-4688-96d2-0b27f9434279 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:47.540944 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:47.554488 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f185115-fbec-4730-aba3-bb48cfffdc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:47.555560 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f185115-fbec-4730-aba3-bb48cfffdc25 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:47.556022 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f185115-fbec-4730-aba3-bb48cfffdc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:47.556521 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f185115-fbec-4730-aba3-bb48cfffdc25 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:47.558230 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f185115-fbec-4730-aba3-bb48cfffdc25 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:47.558695 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f185115-fbec-4730-aba3-bb48cfffdc25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:47.560534 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f185115-fbec-4730-aba3-bb48cfffdc25 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:47.580942 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 341/686] 10.222.0.43 () {56 vars in 1135 bytes} [Wed May 25 13:51:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:47.582511 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f185115-fbec-4730-aba3-bb48cfffdc25 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:47.639372 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708646f0-9776-4688-96d2-0b27f9434279 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:47.683567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1113b3-b4f4-40fd-88cf-44395dcb287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:47.684254 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1113b3-b4f4-40fd-88cf-44395dcb287a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:47.684567 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1113b3-b4f4-40fd-88cf-44395dcb287a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:47.684812 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1113b3-b4f4-40fd-88cf-44395dcb287a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:47.685811 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1113b3-b4f4-40fd-88cf-44395dcb287a None admin] RBAC: Adding query filter params (role.id=97c702855bb64e118e62642a59a444b9, scope.project.id=8686972299d942168ba6ed9c25bf6ec9, user.id=7c0f3b9c9a1744cc965412231e96a74c) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:47.685991 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1113b3-b4f4-40fd-88cf-44395dcb287a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:47.687395 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1113b3-b4f4-40fd-88cf-44395dcb287a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:47.698256 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 346/687] 10.222.0.43 () {56 vars in 1374 bytes} [Wed May 25 13:51:47 2022] GET /identity/v3/role_assignments?user.id=7c0f3b9c9a1744cc965412231e96a74c&scope.project.id=8686972299d942168ba6ed9c25bf6ec9&role.id=97c702855bb64e118e62642a59a444b9 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:47.699101 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1113b3-b4f4-40fd-88cf-44395dcb287a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:47.703114 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f185115-fbec-4730-aba3-bb48cfffdc25 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:47.734905 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:47.753387 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439f9f9-6166-4634-80be-b32550aee4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:47.754490 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439f9f9-6166-4634-80be-b32550aee4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:47.755008 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439f9f9-6166-4634-80be-b32550aee4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:47.755427 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439f9f9-6166-4634-80be-b32550aee4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:47.756420 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439f9f9-6166-4634-80be-b32550aee4c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:47.756883 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439f9f9-6166-4634-80be-b32550aee4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:47.758497 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439f9f9-6166-4634-80be-b32550aee4c7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:47.778682 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 342/688] 10.222.0.43 () {56 vars in 1099 bytes} [Wed May 25 13:51:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:47.784670 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439f9f9-6166-4634-80be-b32550aee4c7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:47.816018 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1113b3-b4f4-40fd-88cf-44395dcb287a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:47.848702 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:47.885617 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e075c6-9798-4ad2-854a-973754425d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:47.886286 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e075c6-9798-4ad2-854a-973754425d46 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:47.886569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e075c6-9798-4ad2-854a-973754425d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:47.886845 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e075c6-9798-4ad2-854a-973754425d46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:47.952642 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439f9f9-6166-4634-80be-b32550aee4c7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:47.990451 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e075c6-9798-4ad2-854a-973754425d46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:47.992939 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e075c6-9798-4ad2-854a-973754425d46 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:47.999159 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee40a-98a2-4617-97d7-c0f40f27d4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:48.000163 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee40a-98a2-4617-97d7-c0f40f27d4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:48.000511 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee40a-98a2-4617-97d7-c0f40f27d4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:48.001030 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee40a-98a2-4617-97d7-c0f40f27d4c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:48.020154 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ee40a-98a2-4617-97d7-c0f40f27d4c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:48.021620 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ee40a-98a2-4617-97d7-c0f40f27d4c3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:48.041164 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c30ee40a-98a2-4617-97d7-c0f40f27d4c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:48.046122 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:48.054149 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:48.055037 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:48.055037 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:48.055037 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:48.055037 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:48.055037 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 343/689] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:48.060951 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee40a-98a2-4617-97d7-c0f40f27d4c3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:48.137562 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 347/690] 10.222.0.43 () {58 vars in 1282 bytes} [Wed May 25 13:51:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:51:48.138740 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e075c6-9798-4ad2-854a-973754425d46 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:48.172889 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:48.180586 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee40a-98a2-4617-97d7-c0f40f27d4c3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:48.216824 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c26422-9aa2-49f9-acab-b01c6adf6f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:48.217846 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c26422-9aa2-49f9-acab-b01c6adf6f77 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:48.218370 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c26422-9aa2-49f9-acab-b01c6adf6f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:48.218866 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c26422-9aa2-49f9-acab-b01c6adf6f77 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:48.219837 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c26422-9aa2-49f9-acab-b01c6adf6f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:48.220352 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c26422-9aa2-49f9-acab-b01c6adf6f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:48.222272 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c26422-9aa2-49f9-acab-b01c6adf6f77 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:48.235040 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 344/691] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:48.240648 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c26422-9aa2-49f9-acab-b01c6adf6f77 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:48.249219 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e075c6-9798-4ad2-854a-973754425d46 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:48.287020 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:48.288824 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3fcad-df16-49db-9938-a0fe663c8e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:48.289637 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3fcad-df16-49db-9938-a0fe663c8e1c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:48.289929 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3fcad-df16-49db-9938-a0fe663c8e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:48.290213 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3fcad-df16-49db-9938-a0fe663c8e1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:48.302569 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3fcad-df16-49db-9938-a0fe663c8e1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:48.304189 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3fcad-df16-49db-9938-a0fe663c8e1c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9aa3fcad-df16-49db-9938-a0fe663c8e1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:51:48.322790 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:48.323832 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:48.324720 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:51:48.324720 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:51:48.324720 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:51:48.324720 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:48.328244 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 348/692] 10.222.0.43 () {56 vars in 1108 bytes} [Wed May 25 13:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:51:48.330135 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3fcad-df16-49db-9938-a0fe663c8e1c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:48.482873 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3fcad-df16-49db-9938-a0fe663c8e1c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:48.519375 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c01f1-0b01-41bd-a4ea-644263cb645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:48.520073 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c01f1-0b01-41bd-a4ea-644263cb645e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:48.520363 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c01f1-0b01-41bd-a4ea-644263cb645e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:48.520944 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c01f1-0b01-41bd-a4ea-644263cb645e None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:48.521864 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c01f1-0b01-41bd-a4ea-644263cb645e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:48.522274 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c01f1-0b01-41bd-a4ea-644263cb645e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:48.523823 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c01f1-0b01-41bd-a4ea-644263cb645e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:48.542494 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 349/693] 10.222.0.43 () {56 vars in 1109 bytes} [Wed May 25 13:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:48.543899 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c01f1-0b01-41bd-a4ea-644263cb645e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:48.561933 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c26422-9aa2-49f9-acab-b01c6adf6f77 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:48.602367 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1b565-7998-4ce6-85dc-438581a67c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:48.603519 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1b565-7998-4ce6-85dc-438581a67c66 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:48.604105 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1b565-7998-4ce6-85dc-438581a67c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:48.604214 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:48.604297 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1b565-7998-4ce6-85dc-438581a67c66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:48.612899 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1b565-7998-4ce6-85dc-438581a67c66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:48.621367 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1b565-7998-4ce6-85dc-438581a67c66 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-38f1b565-7998-4ce6-85dc-438581a67c66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:51:48.629454 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:48.630608 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:48.631790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:48.631790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:48.631790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:51:48.631790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:51:48.631790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:51:48.631790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:51:48.631790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:51:48.631790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:51:48.631790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:51:48.631790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: ERROR keystone.server.flask.application May 25 13:51:48.631790 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 345/694] 10.222.0.43 () {56 vars in 1093 bytes} [Wed May 25 13:51:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:48.662823 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c01f1-0b01-41bd-a4ea-644263cb645e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:48.694996 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf628f-c044-44b5-8b3f-d17931c1e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10eec1f5d0fc4da09d1b4c7f6fd362eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:48.695814 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf628f-c044-44b5-8b3f-d17931c1e195 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:48.696101 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf628f-c044-44b5-8b3f-d17931c1e195 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:48.696381 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf628f-c044-44b5-8b3f-d17931c1e195 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:48.703269 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf628f-c044-44b5-8b3f-d17931c1e195 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:48.704757 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf628f-c044-44b5-8b3f-d17931c1e195 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-8edf628f-c044-44b5-8b3f-d17931c1e195 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:51:48.719703 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:51:48.721382 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( May 25 13:51:48.722495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:51:48.722495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:51:48.722495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:51:48.722495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:51:48.722495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:51:48.722495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:51:48.722495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:51:48.722495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: ERROR keystone.server.flask.application May 25 13:51:48.722495 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 350/695] 10.222.0.43 () {56 vars in 1111 bytes} [Wed May 25 13:51:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:51:58.617422 dv-cinder-843277-1-iscsi devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:58.708081 dv-cinder-843277-1-iscsi devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=49 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}